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Abstract 

Factor  analysis  is  a  multivariate  statistical  procedure  for  analyzing  and  reduc¬ 
ing  large  data  sets.  Many  factor  analysis  schemes  and  techniques  are  available  that 
lead  to  strikingly  different  results  from  the  same  data.  This  research  effort  used 
a  Monte  Carlo  approach  to  investigate  the  properties  of  two  rotation  methods  for 
simple  structure,  Kaiser’s  raw  and  normal  varimax  criterion.  Data  sets  were  devel¬ 
oped  from  a  set  of  contrived  experimental  factor  patterns  by  multiplying  each  factor 
pattern  by  its  transpose  to  create  a  covariance  matrix.  Data  sets  of  multivariate  nor¬ 
mal  deviates  were  in  turn  generated  from  each  covaricince  matrix  via  the  Choleski 
algorithm.  Rotated  factor  pattern  matrices  from  each  data  set  were  compared  t  •> 
their  respective  experimental  factor  pattern  on  the  basis  of  structure,  loadings  and 
eigenvalues.  These  performance  issues  are  addressed  through  regression  analysis 
and  separate  factor  an2dysis  in  which  the  grand  mean  of  proposed  measures  of  effec¬ 
tiveness  are  predicted.  These  measures  of  effectiveness  include  structure  matching 
and  root  mean  square  error  between  the  experimental  and  observed  factor  patterns. 
Several  methods  of  characterizing  factor  pattern  complexity  and  predicting  rotation 
criterion  performance  are  explored. 
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A  Monte  Carlo  Study  Of  The  Raw  And  Normal 
Varimax  Rotation  Criterion  In 
Factor  Analysis 


I.  Introduction 

The  concept  that  nations  must  be  prepared  to  defend  tliemselves  at  all  times 
from  every  type  of  outside  threat  is  a  relatively  modern  one.  Prior  to  World  War  II, 
countries  relied  on  troop  mobilization  and  conscription  rather  than  a  large  standing 
army.  Fortunate  for  the  ill-equipped  and  poorly  trained  troops  entering  WV/  II, 
our  scientific  and  industrial  communities  were  able  to  put  new  technology  on  the 
battle  field  in  numbers  large  enough  to  bring  about  a  favorable  end.  Also  fortunate 
was  the  successful  application  of  quantitative  economic  analysis  and  other  scientific 
methods  to  military  operations.  Since  that  time,  we  have  seen  exponential  increases 
net  only  in  weapon  lethality  but  also  in  the  speed  and  range  of  weapon  deployment. 
The  time  to  develop  and  transition  new  technology  to  the  battlefield  is  a  luxury 
we  no  longer  enjoy,  making  all  future  wars  come  as  you  are.  As  this  new  policy  of. 
military  preparedness  evolved,  so  did  the  role  of  the  operations  analyst.  Today’s 
military  establishment  has  accepted  the  idea  that  analytic  techniques  can  be  aoplied 
to  military  policy,  strategy  and  tactics  on  a  regular  basis. 

1.1  Background 

The  modern  operations  analyst  assists  decision  makers  in  allocating  resources 
for  the  planning,  development,  acquisition  and  use  of  military  systems.  In  the  cur¬ 
rent  environment  of  radical  force  reductions,  effective  and  efficient  allocation  is  crit¬ 
ical.  Rather  than  recommend  a  specific  course  of  action,  the  analyst  best  serves  the 
decision  maker  by  providing  insight  into  competing  alternatives.  This  is  often  ac- 
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coinplished  through  tlu*  analyst’s  ability  to  ({tiantify  complex  interrelationships  and 
retiuce  unmanageable  amounts  of  information.  Factor  analysis  is  an  analysis  tool 
well  suited  to  this  type  of  task.  Originally  d«‘velop€*d  to  study  behavioral  and  bio¬ 
logical  phenomenon,  factor  analysis  is  a  statistical  technique  for  simplifying  complex 
relationships  that  exist  among  a  set  of  observed  variables.  It  accomplishes  this  by 
identifying  latent  common  factors  within  a  data  set.  By  linking  seemingly  unrelated 
variables,  these  factors  provide  insight  into  the  interrelationship  and  sUucture  of  the 
data  (Dillon  and  Goldstein,  1972:.53). 

1.2  Problem  SMement 

Although  factor  analysis,  the  technique,  goes  back  to  the  turn  of  the  century, 
(Jackson,  1991:388)  it  is  the  increased  computational  capability  of  modem  computer 
systems  that  has  its  application  practical.  While  this  made  factor  analysis  very  ac¬ 
cessible,  it  also  led  to  the  proliferation  of  many  different  factor  analysis  techniques 
and  variations.  Subjective  selection  of  a  particular  technique  can  lead  to  results  strik¬ 
ingly  different  from  that  of  another  researcher  investigating  the  same  data.  Because 
of  this  failure  to  render  a  unique,  reproducible  solution,  many  researchers  consider 
factor  analysis  unsatisfactory  as  a  scientific  methodology. 

1.3  Research  Objectives 

1.5.1  Objective.  1  The  primary  objective  of  this  research  effort  was  to  de¬ 
velop  and  use  a  Monte  Carlo  simulation  to  assess  the  sensitivity  of  factor  analysis 
accuracy  in  response  to  such  effects  as  sample  sire,  variable  to  factor  ratio,  factor 
loading  strengths  and  structure  complexity.  The  simulation  was  written  in  FOR¬ 
TRAN  and  allows  for  any  modifications  necessary  to  conduct  future  sensitivity  anal¬ 
ysis  beyond  the  scope  of  this  effort. 

1.3.2  Secondary  Objectives.  Methods  to  measure  and  characterize  the  be¬ 
havior  of  data  to  be  factor  analyzed  were  developed.  Quantifying  such  behavior  pro- 
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vidcs  insight  into  the  accuracy  to  expect  from  different  factor  analysis  techniques. 
This  information  can  provide  guidelines  for  methodology  selection,  and  limit  the 
amount  of  subjectivity  introduced  by  the  analyst  conducting  factor  analysis  activi- 


11.  Literature  Review 


Factor  analysis  saw  most  of  its  early  application  in  psychology  where  it  became 
a  valuable  tool  in  measuring  underlying  differences  in  aptitude  as  measured  by  indi¬ 
vidual  test  scores  (Frutcher,  1959:vii).  Most  information  concerning  the  evolution  of 
factor  analysis  is  therefore  concentrated  in  literature  specific  to  this  area.  In  addition 
to  its  inherent  subjectivity,  perhaps  it  is  also  the  association  with  this  science  that 
causes  many  to  view  factor  analysis  with  suspicion.  Edward  Jackson  summarizes 
this  very  well  in  his  User’s  Guide  to  Principal  Components  when  he  says, 

...the  solutions  were  not  unique  and  the  early  reputation  of  factor  analysis 
was  felt  by  many  in  the  statistical  community  to  be  closely  associated 
with  witchcraft"  (Jackson,  1991:388). 

2.1  Principal  Components  Analysis 

Similar  in  nature  to  factor  ansdysis,  principal  components  analysis  is  another 
statistical  method  that  can  be  applied  to  a  group  of  variables.  They  are  edike  in 
that  both  analyze  the  inter  correlation  2unong  variables  within  a  single  set  rather 
than  external  criteria  as  in  other  multivariate  techniques.  Both  attempt  to  reduce 
the  number  of  variables  into  subgroups.  However,  principal  components  analysis 
performs  this  reduction  by  deriving  a  small  set  of  linear  combinations  of  the  original 
variables  that  explains  as  much  of  the  totsJ  variance  of  the  data  as  possible.  Con¬ 
versely,  factor  analysis  concentrates  on  the  variance  shetred  by  the  variables.  Simply 
put,  principal  components  analysis  views  unobservable  factors  as  a  function  of  the 
variables,  while  factor  analysis  treats  the  variables  as  a  function  of  the  unobservable 
factors  (Bauer,  1992). 

2.2  Common  Factor  Analytic  Approach 

The  factor  analysis  model  assumes  a  set  of  intercorrelated  variables  with  each 
variable  composed  of  both  common  and  unique  parts.  The  common  part,  called 
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communality,  is  the  portion  of  a  variable’s  variance  that  is  shared  with  other  v^iables 
in  the  data  set.  The  unique  part,  known  as  uniqueness,  is  that  vari^ulce  belonging 
to  this  variable  alone.  Any  variance  due  to  measurement  or  experimental  error 
would  also  contribute  to  the  unique  part  of  the  variable.  Shared  variance  provides 
a  means  oi  forming  the  data  into  coherent  relatively  independf  .t  subgroups.  By 
studying  the  structure  of  the  subgroups  we  can  gain  insight  into  the  process  that 
.generated  the  combination  of  outcomes  measured  by  the  variables.  In  addition  to 
observing  the  relationship  of  the  variables,  factor  analysis  also  enables  us  to  reduce  a 
large  data  set  to  a  smaller,  more  manageable  set  of  unobservable  variables  known  as 
common  factors  (Tabachnick  and  Fidell,  1983:374).  The  strength  of  the  relationship 
(correlations)  between  the  observable  variables  and  unobservable  factors  is  indicated 
by  values  known  as  factor  loadings.  An  algebraic  representation  of  a  two  factor 
model  for  a  four  variable  data  set  is  given  below. 


~  An/i  -f  Aij/j  +  ej 

(2.1) 

X2  =  ^21  fi  +  A22/2  +  €2 

(2.2) 

X3  =  Aai/i  -j-  A32/2  -1-  63 

(2-3) 

•^4  =  A41/1.  -b  A42/2  +  C4 

(2.4) 

where 

Ay  is  the  correlation  of  variable  Xi  with  factor  fj, 
i  =  l,...,p 

and 

j  = 


2-2 


Also,  the  sum  squared  factor  loadings  for  Xi 


(2.5) 

i 

is  the  variable’s  communality,  the  variance  accounted  for  by  all  the  factors.  There¬ 
fore, 


*.  =  1  -  A?  (2.6) 

is  the  uniqueness,  the  variance  not  accounted  for  by  the  factors.  The  common  factor 
analytic  model  is  normally  summarized  as  follows: 

X  =  +  (2.7) 

where 

X  is  the  p  X  1  vector  of  observed  responses, 

A  is  the  p  x  q  matrix  of  unknown  constants  (factor  loexiings), - 

/  is  the  ^  X  1  vector  of  unobservable  variables  (common  factors), 

and 

$  is  the  p  X  1  vector  of  unobservable  variables  (unique  factors). 

The  process  of  calculating  the  correlations  (factor  loadings)  between  the  observ¬ 
able  variables  and  the  unobservable  factors  is  known  as  factor  extraction.  Because 
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the  calculations  for  factor  extraction  are  involved  and  complex,  this  section  is  limited 
to  the  fundamental  equations  necessary  to  show  the  genertil  approach  for  extracting 
factors  from  a  data  set.  The  procedure  is  outlined  below: 

•  First,  the  data  set  should  consist  of  several  subjects  each  of  which  has  been 
measured  on  p  variables. 

•  Generate  E,  the  px  p  data  correlation  matrix 

•  Calculate  the  associated  eigenvectors  and  eigenvalues 


E  =  VLV'^ 


(2.8) 


where 

E  is  the  p  X  p  correlation  matrix, 

V  is  the  p  X  p  matrix  of  eigenvectors 


and 

L  is  the  p  X  p  diagonal  matrix  of  eigenvalues. 


•  Finally,  extract  the  p  x  p  factor  loading  matrix 

A  =  VVl  (2.9) 

where 

V  is  p  X  d,  d  being  the  number  of  retained  factors  (dimensionality). 
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The  reader  should  note  that  the  eigenvalues  describe  the  total  variance  ex¬ 
plained  by  the  respective  common  factors.  Eigenvalues  can  be  calculated  from  a 
factor  loading  matrix  by  summing  the  square  of  the  factor  loadings  for  each  column 
as 


E4-  (2.10) 

} 

2.3  Dimensionality  Assessment 

Prior  to  extracting  the  factor  loading  matrix,  the  analyst  must  make  a  di¬ 
mensionality  assessment  in  terms  of  deciding  how  many  of  the  fj  factors  should  be 
retained.  The  number  of  eigenvalues,  eigenvectors  and  corresponding  common  fac¬ 
tors  will  equal  the  number  of  variables  in  the  data  set.  Therefore,  while  reducing 
the  dimensionality  of  the  data  set  is  desirable,  it  must  be  done  without  jeopardizing 
our  ability  to  interpret  the  .data  structure.  Several  methods  have  been  put  forth  to 
assist  in  dimensionality  assessment,  including  the  scree  test  (Catell,  1966),  Horn’s 
test  (Horn,  1965)  and  Kaiser’s  critei  i  i  (Kaiser,  1960).  Kaiser’s  criteria  is  one  of  the 
simplest  methods  in  that  it  suggests  discarding  all  factors  with  an  eigenvalue  less 
than  one.  For  detailed  information  on  dimensionality  aissessment,  especially  as  it 
applies  to  factor  analysis,  see  (Bauer,  1981).  — ^ 

2.4  Exploratory  versus  Confirmatory  Factor  analysis 

Factor  analysis  is  normally  conducted  in  one  of  two  contexts.  In  the  exploratory 
context,  the  researcher  has  no  idea  what  the  underlying  structure  of  the  data  may  be 
and  conducts  factor  analysis  for  the  purpose  of  gaining  insight  into  that  structure. 
If  the  researcher  has  no  prior  information  concerning  the  underlying  structure  of  the 
data  or  is  testing  some  hypothesis  for  the  structure,  he  is  conducting  confirmatory 
factor  analysis. 
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2.5  Factor  Interpretation 

When  interpreting  a  factor  pattern,  we  investigate  the  A,;  loadings  of  the  factor 
pattern  matrix  so  as  to  identify  factor- variable  correlations  and  to  determine  the 
strength  of  these  correlations.  A  commonly  used  interpretation  heuristic  applied 
against  an  example  two  factor  by  six  variable  model  (Lawley  and  Maxwell,  1971)  in 
Table  2.1  demonstrates  factor  interpretation. 

•  For  each  variable,  move  across  the  factors  (row)  selecting  the  loading  value 
with  the  largest  absolute  value 

•  Assess  each  selected  loading  for  significance.  A  common  rule  of  thumb  requires 
a  loading  to  be  greater  than  .30 

•  Address  each  variable  not  loaded  on  a  factor  and  decide  if,  based  on  its  impor- 
tcuice  to  the  analysis,  the  variable  should  be  dropped 

•  Assign  some  intuitive  meaning  to  the  pattern  of  selected  loadings  that  describes 
the  meaning  of  the  variables  that  load  on  each  of  the  factors 


Table  2.1.  Example  Factor  Pattern  Interpretation 


Variables 

fi  h 

ft?  *r 

Gaelic 

.553  .429 

.490  .510 

English 

.568  .288 

.406  .594 

History 

.392  .450 

.356  .644 

Arithmetic 

.740  .-273 

.623  .377 

Algebra 

.724  .-211 

.569  .431 

Geometry 

.595  .-132 

.372  .628 

If  this  factor  pattern  had  been  extracted  from  data  corresponding  to  six  different 
sets  of  test  scores,  for  exaunple,  the  researcher  might  infer  that  History  is  influenced 
by  a  mental  process  independent  from  that  influencing  the  other  subjects. 
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2.6  Simple  Structure 

Unfortunately,  not  all  loading  matrices  possess  structures  so  simple  as  to  allow 
this  kind  of  interpretation  procedure.  A  variable  often  has  moderate  loadings  on 
more  than  one  factor.  In  these  situations,  pattern  interpretation  can  become  very 
subjective  and  difficult  to  reproduce.  If  we  could  reduce  the  number  of  significant 
loadings  for  a  given  variable,  hopefully  the  structure  would  be  simplified  and  easier 
to  interpret.  Before  addressing  the  various  methods  for  simplifying  a  factor  pattern, 
it  is  necessary  to  decide  upon  some  type  of  criterion  for  simple  structure.  One  of  the 
first  and  still  widely  accepted  criterion  was  suggested  by  Thurstone  in  1932  (Kaiser, 
1958:187).  This  criterion  for  a  p  x  9  loading  matrix  consists  of  the  following  five 
main  points  (Morrison,  1990:368): 

•  Each  row  should  contain  at  least  one  zero 

•  Each  column  should  contain  at  least  q  zeros 

•  Every  paur  of  columns  should  contain  several  responses  whose  loadings  vanish 
in  one  column  but  not  in  the  other 

•  If  the  number  of  factors  is  four  or  more,  every  pair  of  columns  should  contain 
a  large  number  ox  responses  with  zero  loadings  in  both  columns 

•  Conversely,  for  every  pair  of  columns  only  a  small  number  of  responses  should 
have  nonzero  loadings  in  both  columns 

Since  simple  structures  meeting  all  of  Thurstone’s  conditions  are  rarely  found  in 
real  world  data,  most  simplification  techniques  emphasize  different  aspects  of  Thur¬ 
stone’s  criterion.  These  techniques  fall  into  a  class  of  methodologies  known  bls  factor 
rotations. 

2. 7  Factor  Rotation 

A  factor  rotation  is  any  transformation  of  eigenvectors  or  original  variables  that 
seeks  to  simplify  pattern  structure  (Jackson,  1991:167).  Carroll  proposed  one  of  the 
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first  analytic  criterion  for  approximating  sirnple  structure.  His  method  minimized 
the  sums  of  cross  products  (across  factors)  of  squares  of  factor  loadings  (Carroll, 
1953).  While  arriving  at  a  unique  solution  and  approximating  a  simple  structure, 
Carroll’s  method  was  very  computationally  complex.  Howe,  and  Lawley  and  Maxwell 
proposed  least  squares  methods  for  rotating  as  closely  as  possible  to  a  pattern  of  zero 
amd  nonzero  loadings.  Joreskog  developed  a  methodology  utilizing  hypothesis  test¬ 
ing  for  simple  structure  (Morrison,  1990:369).  A  factor  pattern  and  its  associated 
rotated  factor  pattern  are  shown  below  in  Table  2.2  to  illustrate  the  structure  sim¬ 
plification  that  can  be  accomplished  through  factor  rotation.  Although  they  have 
identical  communality  and  uniqueness,  note  how  using  our  simple  heuristic,  the  ro¬ 
tated  pattern  on  the  right  is  far  easier  to  interpret  than  the  original  pattern  on  the 
left. 


Table  2.2.  Example  Unrotated  versus  Rotated  Factor  Pattern 


Variables 

fl  f2 

~hr~w 

Gaelic 

.55  .42 

.49  .51 

English 

.56  .28 

.40  .59 

History 

.39  .45 

.35  .64 

Arithmetic 

.74  -.27 

.62  37 

Algebra 

.72  -.21 

.56  .43 

Geometry 

.59  -.13 

.37  .62 

ft 

/z 

fiTW 

.36 

.50 

.49 

.51 

.43 

.46 

.40 

.59 

.21 

.55 

.35 

.64 

.78 

.00 

.62 

.37 

75 

.05 

.56 

.43 

.60 

.08 

.37 

.62 

Also  note  that  the  structuie  of  the  rotated  pattern  has  ch£uiged  from  that  of  the 
original  factor  pattern.  A  researcher  might  now  infer  that  two  separate  processes 
underlie  the  test  scores.  Namely,  language  and  History  are  creative  or  right  brain 
activities,  while  the  remaining  subjects  are  analytical  or  left  brdn  activities.  As  men¬ 
tioned,  simplification  can  reduce  some  of  the  subjectivity  in  structure  interpretation. 
But  we  idso  said  each  rotation  technique  may  choose  to  accomplish  simple  structure 
through  a  different  aspect  of  Thurstone’s  criterion.  Therefore,  what  was  intended 


to  introduce  objective,  scientific  methodology  into  the  process  has  aggravated  the 
problem  and  generated  controversy.  David  Saunders  wrote: 


While  some  have  argued  that  computers  should  be  used  to  do  factor  anal¬ 
ysis  better,  rather  merely  more  quickly,  it  has  been  difficult  to  define  what 
better  should  mean.  Rotation  is  one  of  the  difficult  Ccises  in  point.  Since 
computers  have  become  available,  there  have  been  no  less  than  fifteen 
distinguishable  approaches  to  formulations  of  simple  structure  that  are 
more  or  less  amenable  to  computer  programming.  (Saunders,  1960:199) 


The  thirty  years  since  this  statement  have  seen  little  improvement.  In  his  Ph.D. 


thesis,  Henry  F.  Kaiser  addressed  some  of  the  origined  attempts  to  strip  away  the 
subjectivity  of  factor  rotation  sc  factor  analysis  could  beconie  a  proper  tool  for  sci¬ 


entific  inquiry.  All  of  these  attempts  employed  some  form  of  linathematical  condition 
for  simple  simple  structure. 

2.8  Quartimax  Criterion 

Neuhaus  and  Wrigley,  Saunders  and  Ferguson  simults  neously  suggested  one 


of  the  first  rotation  criterion  for  simple  structure  (Kaiser,  1968:188).  Known  as  the 
Quartimax  criterion,  it  seeks  to  maximize  the  sum  of  the  fourt  ii  powers  of  the  rotated 
loadings.  This  is  the  mathematical  equivalent  of  attempting  to  place  only  one  major 
loading  on  a  given  factor.  The  quaurtimax  criterion  remauns  one  of  the  most  popular 


and  accessible  methodologies  today.  Its  formulated  as 


(2.11) 


This  was  intended  to  fulfill  Thurstone’s  requirement  that  a  large  loading  on  one 
factor  should  be  opposite  a  smadl  loaiding  on  any  adjacent  factor. 
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2.9  Varimax  Criterion 


Henry  Kaiser  criticized  the  quartimax  approach  because  he  felt  it  concen¬ 
trated  too  much  on  Thurstone’s  mathematically  unmana/;eable,  qucilitative  condi¬ 
tions.  Proposing  a  departure  from  Thurstone’s  criterion,  Kaiser  pursued  simple 
structure  by  maximizing  the  variance  of  the  loadings  across  variables  within  factors. 
With  this  approach,  loadings  tend  to  become  higher  for  those  variables  with  high 
correlations  with  a  factor  and  smaller  for  the  other  variables  (Tabachnick  and  Fidell 
,1983:398).  Kaiser  named  this  criterion  the  va^im^lx  criterion.  Varimax  is  also  a 
very  popular  rotation  procedure  and  is  found  in  all  statistics  software  packages.  Its 
formulation  is 


«  r  j» 

i=i  L<=i 


(n.,  xh) 


(2.12) 


2.10  Normal  Varimax  Criterion 

Kaiser  conducted  numerous  experiments  to  assess  the  properties  of  both  the 
quartimax  and  varimax  criterion.  In  these  experiments,  he  generated  rotated  factor 
patterns  with  the  quartimax  and  varimax  criterion  from  data  produced  by  a  series 
of  twenty-four  psychological  tests  administered  by  Holzinger  2md  Harman  (Kaiser, 
1958:192).  Given  to  a  set  of  forty-five  school  children,  these  tests  were  designed 
to  measure  such  aptitudes  as  visual  perception,  paragraph  comprehension,  word 
comprehension,  and  problem  re£isoning  (Dillon  and  Goldstein,  1984:310).  The  cor¬ 
relations  and  structure  of  this  data  were  well  documented,  giving  Kaiser  a  priori 
knowledge  as  to  the  structure  each  rotation  criterion  needed  to  recover.  Kaiser 
found  that  quartimax  tended  to  create  a  large  gener2d  factor,  but  varimax  recovered 
the  Holzinger  and  Harman  factor  pattern  fairly  well.  However,  he  noted  a  bi<is  in  the 
varimax  loadings  in  which  all  loadings  of  the  factors  with  the  larger  variance  contribu¬ 
tions  were  larger  than  the  loeidings  for  the  smaller  factors  (Kaiser,  1958:192).  Recall 


2-10 


from  the  previous  section  on  the  factor  analytic  approach  that  variance  contribution 
of  a  factor  is  explained  by  that  factor’s  associated  eigenvalue.  Kaiser  attributed  the 
observed  bias  to  the  fact  that  the  varimax  criterion  was  a  fourth-power  function. 
He  reasoned  that  each  variable  in  the  unrotated  factor  pattern  is  weighted  by  its 
communality,  and  that  in  a  fourth-power  function,  a  variable  with  a  communality  of 
0.6,  for  example,  would  be  influenced  by  the  rotation  criterion  four  times  as  much  as 
a  variable  with  a  communality  of  0.3  (Kaiser,  1958:193).  As  discussed,  the  commu¬ 
nality  of  a  variable  is  the  sum  squared  factor  loadings  for  that  Vturiable.  Assuming  a 
one  factor  model,  a  variable  with  a  communality  of  0.6  would  have  a  corresponding 
factor  loading  of  0.77.  Similarly  the  communality  0.3  has  a  corresponding  factor 
loading  of  0.54.  When  we  take  the  fourth  power  of  the  factor  loadings,  the  value 
resulting  from  the  larger  loading  is  four  times  that  of  the  smaller  loading,  or  .35 
versus  .085. 

To  compensate  for  this  bias,  Kaiser  normalized  the  extracted  factors  to  reduce 
the  relative  influence  of  each  test  during  the  rotation.  This  consisted  of  dividing 
each  variable’s  loading  by  the  square  root  of  its  commun2ility.  After  rotation,  these 
weighting  factors  are  removed  (Kaiser,  1958:193).  From  thi'.  point  Kaiser  called  the 
weighted  version  of  the  varimax  criterion  a  normal  varimax,  and  the  original  version 
subsequently  became  known  raw  varimax.  The  formulation  for  normal  varimax  is 

where 

A”  is  equal  to  A,j  weighted  by  the  communality  of  variable  Af,-, 


9 

max^ 

f=i 
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Kaiser  confessed  to  having  no  rational  basis  for  choosing  this  weighting  scheme, 
and  admitted  making  a  numerical-intuitive  selection.  Indeed,  the  normal  varimax 
criterion  did  recover  the  Holzinger  and  Harman  structure  without  the  disturbing 
bias  found  in  the  raw  varimax  solutions.  One  side  effect  of  the  normal  varimax 
criterion,  however,  was  that  it  reduced  the  divergence  of  the  eigenvalues.  We  contend 
that  significant  alteration  of  eigenvalues  removes  important  information  regarding 
the  significance  of  the  factors  and  thus  the  variance  explained  by  the  factors.  For 
this  reason,  eigenvalue  recovery  for  the  Holzinger  and  Harman  data  should  have 
been  included  as  a  measure  of  effectiveness  when  the  normal  vzurimax  criterion  was 
evaluated. 

2.11  Monte  Carlo  Studies 

The  properties  of  many  models  and  computational  algorithms  have  become 
fairly  well  understood  as  a  result  of  Monte  Carlo  studies.  A  Monte  Carlo  study 
is  a  class  of  study  that  employs  random  variatss  to  solve  statistical  problems  that 
are  insensitive  to  the  passage  of  time.  These  statistical  problems  are  usually  not 
analytically  tractable  (Law  and  Ksltou,  1991:113-114). 

2.11.1  MacCallum  Study.  In  1977  MacCallum  conducted  a  Monte  Carlo 
study  to  determine  the  the  ability  of  AT  SCAL,  a  computerized  ^dgorithm,  to  re¬ 
cover  true  structure  inherert  in  simulated  proximity  measures  (M2u:CaIIum,  1977). 
ALSCAL  attempts  to  identify  separate  homogeneous  subgroups  of  individuals  within 
a  sample,  then  represent  each  subgroup  by  a  real  or  hypothetical  individual.  The  so¬ 
lution  is  intended  to  provide  information  about  stimulus  relationships  charcurterizing 
different  subgroups.  In  their  study  they  generated,  for  a  sample  of  individuals,  a  set 
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of  simulated  proximity  values  with  a  known  structure.  After  analyzing  these  values 
with  the  ALSCAL  procedure  they  measured  the  degree  to  which  ALSCAL  was  able 
to  recover  the  inherent  structure.  The  number  of  stimuli,  the  number  of  individuals, 
the  dimensionality,  and  the  level  of  random  error  were  all  varied.  In  addition  to 
structure,  they  also  measured  ALSfML’s  ability  to  recover  stimulus  dimension  and 
individual  stimulus  weights.  One  interesting  discovery  was  that  over  the  range  of 
their  study,  the  number  of  individuals  had  no  influence  on  the  other  measures  of 
recovery. 

S.It.2  Cliff  and  Pennell  Study.  In  this  study  Cliff  and  Pennell  used  a 
Monte  Carlo  approach  to  determine  if  certain  variables  produced  systematic  effects 
on  the  sampling  variability  of  individual  factor  loadings  (Cliff  and  Pennell,  1967). 
They  believed  a  researcher’s  greatest  concern  to  be  whether  or  not  to  expect  a 
radically  different  structure  for  the  same  variables  when  obtaining  another  sample 
from  the  same  population  and  whether  a  given  loading  was  statistically  significant. 
In  this  effort  they  contrived  two  experimental  factor  matrices  and  multiplied  each 
by  its  transpose  to  produce  a  correlation  matrix.  The  contrived  factor  matrices 
were  created  with  four  different  factor  strengths,  four  different  communalities,  and 
four  different  loading  sizes.  In  turn,  each  correlation  matrix  was  used  to  produce 
fifty  sample  factor  matrices  which  were  then  rotated  .using  a  least  squares  fit,  to  the 
population  values.  After  rotation.  Cliff  and  Pennell  measured  the  standard  deviation 
of  the  sample  loadings  to  determine  their  variability  in  light  of  the  independent 
parameters.  They  observed  no  consistent  relation  between  sample  size  or  loading  size 
and  factor  loading  stability.  Cliff  and  Pennell  did  discover  that  greater  commun2ditie3 
led  to  greater  factor  loading  stability. 

2.1  t.S  Pennell  Study.  Pennell  again  undertook  a  Monte  Carlo  approach  in 
1968  to  further  explore  the  dependence  of  factor  loading  sampling  error  on  sample 
size  and  the  communality  of  the  variable  on  which  the  loading  occurs  (Pennell,  1968). 
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In  this  study,  Pennell  calculated  the  sample  factor  matrices  using  a  method  slightly 
different  from  that  of  his  work  with  Cliff  .  Instead  of  contriving  the  experimental 
factor  matrices,  Pennell  generated  them  randomly.  He  then  created  variables  with 
different  communalities  and  inserted  them  into  randomly  generated  factor  matrices. 
His  work  found  that  increasing  communality  or  sample  size  resulted  in  decreased 
variability  in  individual  loadings.  For  near  zero  loadings,  sample  size  had  the  largest 
influence. 

2.11.4  Tucker,  Koopman  and  Linn  Study.  This  study  used  a  Monte  Carlo 
procedure  to  study  the  effectiveness  of  factor  analytic  methods  using  simulated  cor¬ 
relation  matrices  that  were  more  similar  to  real  data  correlation  matrices  than  tf  ose 
computed  directly  from  factor  patterns.  In  this  approach.  Tucker  started  with  a  fac¬ 
tor  pattern  that  he  called  the  formal  model.  He  then  confounded  his  formal  niodel 
with  the  addition  of  numerous  random  influence  factors  and  error  terms  to  arrive  at 
a  pattern  he  considered  closer  to  real  world.  This  formal  model  was  then  multiplied 
by  its  transpose  to  yield  a  correlation  matrix  which  was  then  factor  analyzed  to 
yield  a  factor  loading  matrix.  This  matrix  was  known  as  the  simulation  model.  The 
simulated  correlation  matrices  were  designed  to  exhibit  different  numbers  of  factors 
(dimensionality)  and  different  proportions  of  variance  (eigenvalues)  explained  by  the 
factors.  When  the  simulation  model  was  compeu-ed  to  the  formal  model,  large  differ¬ 
ences  in  the  quality  of  results  were  noted  with  fewer  factors  and  larger  proportions 
of  factor  variance. 

2.11.5  Bauer  Study.  Bauer’s  Monte  Carlo  study  was  initiated  to  character¬ 
ize  the  properties  of  different  dimensionality  techniques  (Baueir,  1981).  He  addresses 
the  bias  effect  of  sample  size,  number  of  variables,  number  of  factors,  and  struc¬ 
ture  complexity  on  the  Kaiser  and  Catell  Scree  tests  for  dimensionality.  Bauer  Jilso 
generates  sample  factor  loading  matrices  by  factor  analyzing  and  rotating  correla¬ 
tion  matrices  computed  from  the  product  of  a  contrived  factor  lo2uiing  matrix  and 
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its  transpose.  He  determines  the  effectiveness  of  each  dimensionality  procedure  by 
calculating  the  mean  square  error  between  every  contrived  factor  loading  pattern 
and  its  associated  simulated  matrix.  His  work  demonstrated  that  mean  square  error 
could  be  predicted  with  fair  accuracy. 

2.11.6  Summary.  This  chapter  examined  the  development  and  evolution  of 
factor  analysis  as  a  multivariate  analysis  tool.  This  included  discussion  of  the  com¬ 
mon  factor  analytic  model  and  severed  rotation  techniques  for  simplifying  structure. 
Particular  attention  was  paid  to  the  problems  of  subjectivity  and  proliferation  of 
factor  rotation  criteria.  We  also  reviewed  many  efforts  to  understand  the  properties 
of  different  fzwitor  analysis  techniques  and  to  identify  influential  effects.  A  Monte 
Carlo  approach  was  central  to  nearly  all  of  these  studies.  The  reader  should  note 
that  there  was  no  evidence  of  this  type  of  study  being  conducted  to  compare  and 
evaluate  rotation  criterion.  True,  Kcuser  and  others  did  some  limited  comparison 
of  the  structures  returned  by  the  quartimax,  raw  varimax  and  normal  varimax  cri¬ 
terion,  but  these  were  extremely  narrow  in  scope.  Recall  that  Kaiser  admits  to  no 
rational  basis  for  selecting  his  method  of  normalizing  factor  loadings.  In  addition,  he 
compares  his  new  criterion  to  raw  varimax  against  one  type  of  factor  pattern.  Re¬ 
member  also  that  his  normal  criterion  tends  to  pull  the  eigenv2dues  closer  together, 
diluting  information  concerning  relative  factor  strengths  and  significance.  Overall, 
Kdser’s  work  raises  some  interesting  questions:  ~ 

•  How  well  does  the  normal  wimax  perform  over  a  wide  range  of  sample  size, 
structure  complexity,  variable  communality  and  factor  loading? 

•  In  addition  to  recovering  the  known  structure  of  an  experimental  factor  pattern, 
how  effective  is  normal  varimax  in  terms  of  returning  variable  loadings  and 
eigenvalues? 

•  With  what  types  of  data  will  normal  varimeoc  not  outperform  raw  varim20c? 

•  Are  there  circumstances  where  neither  rotation  criterion  is  desirable? 
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These  questions  will  be  addressed  throughout  the  course  of  this  effort. 
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HI.  Methodology 


Chapter  three  presents  the  methodology  for  assessing  the  accuracy  and  associ¬ 
ated  properties  of  the  raw  and  normal  criterion  for  varimax  rotation.  This  method¬ 
ology  is  designed  to  investigate  the  impact  of  sample  size,  uniqueness  «uid  structure 
complexity  on  accuracy.  The  first  section  covers  experimental  design  and  rationale, 
followed  by  a  description  of  the  data  generation  techniques.  Section  3  proposes  pre¬ 
dictors  and  measures  of  effectiveness.  The  chapter  concludes  with  a  discussion  of 
the  analysis  conducted  to  explore  the  relationship  between  the  suggested  measures 
of  effectiveness  and  behavior  descriptors. 

3.1  Experimental  Design 

Recall  from  chapter  2  that  Kaiser  based  his  normal  varimax  rotation  crite¬ 
rion  on  a  weighting  scheme  that  enabled  him  to  restore  the  structure  underlying 
Holtzinger  sund  Harman’s  data  from  twenty-four  psychological  tests.  It  must  be 
reemphasized  that  his  validation  efforts  for  this  weighted  V2udmax  were  limited  to 
that  structure  only.  Table  3.1  includes  the  factor  loading  matrix  for  Holzinger  and 
Harmon’s  tests  and  an  additional  matrix  designed  to  show  the  pattern  structure. 

This  matrix  was  generated  by  Holtzinger  and  Harman  through  subjective  rotation 
criterion  aiidTs  accepted  as  the  true  structure  for  the  tests.  The  twenty-four  psycho¬ 
logical  tests  were  combined  to  measure  five  separate  aptitudes  among  grade  school 
children.  Five  underlying  factors  are  clearly  evident  in  the  structure  pattern  ma¬ 
trix.  Kaiser  considered  this,  or  any  structure  with  the  variables  loaded  roughly 
equal  on  the  factors,  a  comple'*’  structure.  Alternately,  he  suggests  that  a  structure 
with  the  all  variables  loaded  on  one  factor  to  be  the  most  simple  possible  structure. 
This  would  agree  with  Thurstone’s  conditions  for  simple  structure  outlined  in  the 
previous  chapter.  In  light  of  the  information  concerning  Kaiser’s  normal  varimax 
development  and  validation,  we  thought  it  prudent  to  investigate  the  sensitivity  of 


3-1 


Table  3.1.  Factor  Loadings  And  Pattern  Structure  For  Holtzinger  and  Harman’s 
Twenty-Four  Psychological  Tests 


A* 

h  h  h  u 

Xx 

X 

X2 

X 

x^ 

X 

Xa 

X 

X, 

X 

Xt 

X 

Xj 

X 

Xs 

X 

X 

^10 

X 

Xn 

X 

Xu 

X 

X 

Xu 

X 

X\h 

X 

Xu 

X 

Xx7 

X 

Xu 

X 

Xu 

X 

Xu 

X 

X21 

X 

X22 

X 

X23 

X 

X24 

X 

A 

h 

/2 

h 

U 

.10 

.32 

.62 

.20 

X2 

.07 

.15 

.41 

.13 

X3 

.10 

.12 

.53 

.13 

X 

.15 

.18 

.53 

.12 

.75 

.15 

.26 

.15 

.72 

.05 

.28 

.25 

X7 

.81 

.08 

.27 

.11 

Xt, 

.54 

.26 

.38 

.14 

x^ 

.76 

0 

1 

.29 

.30 

Xu 

.28 

.66 

.-19 

.14 

Xu 

.27 

.61 

.-04 

.29 

Xu 

.13 

.72 

.09 

.03 

Xu 

.24 

.63 

.31 

.02 

Xu 

.23 

.19 

.-02 

,48 

Xts 

.11 

.14 

.08 

.50 

Xu 

.05 

.22 

.34 

.45 

Xu 

.15 

.24 

.-03 

.62 

Xu 

.01 

.39 

.20 

.52 

Xu 

.12 

.22 

.18 

.39 

X20 

.31 

.18 

.46 

.29 

X21 

.17 

.46 

.33 

.24 

X22 

.31 

.12 

.40 

.40 

X23 

.31 

.29 

.54 

.25 

X24 

.39 

.46 

.14 

.31 

Kaiser’s  criterion  against  structures  of  varying  complexity.  As  seen  in  Tables  3.2, 
3.3  and  3.4,  we  began  the  research  effort  by  constructing  nine  initial  16  variable  by 
4  factor  experimental  factor  patterns. 

Observe  the  three  different  levels  of  structure  complexity  for  these  experimental 
factor  patterns: 


•  Level  1 :  Variables  loaded  equally  on  all  four  factors 

•  Level  2:  Variables  predominantly  loaded  on  the  first  two  factors 


3-2 


Table  3.2.  Initial  Level  1  Theoretical  Factor  Patterns 


Pattern  1 


.9  0  0  0 

.9  0  0  0 

.9  0  0  0 

.9  0  0  0 

0  .9  0  0 

0  .9  0  0 

0  .9  0  0 

0  .9  0  0 

0  0  .9  0 

0  0  .9  0 

0  0  .9  0 

0  0  .9  0 

0  0  0  .9 

0  0  0  .9 

0  0  0  .9 

0  0  0  .9 


Pattern  2 


.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

0  .8  0  0 

0  .8  0  0 

0  .8  0  0 

0  .8  0  0 

0  0  .8  0 

0  0  .8  0 

0  0  .8  0 

0  0  .8  0 

0  0  0  .8 

0  0  0  .8 

0  0  0  .8 

0  0  0  .8 


Pattern  3 


0  0 
.7  0  0  0 

.7  0  0  0 

.7  0  0  0 

0  .7  0  0 
0  .7  0  0 
0  .7  0  0 
0  .7  0  0 

0  0  .7  0 

0  0  .7  0 

0  0  .7  0 

0  0  .7  0 

0  0  0  .7 

0  0  0  .7 

0  0  0  .7 

0  0  0  .7 


Table  3.3.  Initial  Level  2  Theoretical  Factor  Patterns 


Pattern  4 


.9  0  0  0 

.9  0  0  0 

.9  0  0  0 

.9  0  0  0 

.9  0  0  0 

.9  0  0  0 

.9  0  0  0 

0  .9  0  0 

0  .9  0  0 

0  .9  0  0 

0  .9  0  0 

0  .9  0  0 

0  0  .9  0 

0  0  .9  0 

0  0  0  .9 

0  0  0  .9 


Pattern  5 


.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

0  .8  0  0 

0  .8  0  0 

0  .8  0  0 

0  .8  0  0 

0  8  0  0 

0  0  .8  0 

0  0  .8  0 

0  0  0  .8 

0  0  0  .8 


Pattern  6 


.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  -0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
0  .7  0  0 
0  .7  0  0 
0  .7  0  0 
0  .7  0  0 
0  .7  0  0 
0  0  .7  0 

0  0  .7  0 

0  0  .7  0 
0  0  .7  0 


Pattern  7 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

0 

.9 

Table  3.4.  Initial  Level  3  Theoretical  Factor  Patterns 
'  I  I  Pattern  8  I  I  Pattern  9 


Pattern  8 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

0 

.8 

.7 

0 

G 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

0 

.7 

0  0  0  .9  /i?  =.81  0  0  0  .8  hj  =.64  0  0  0  .7  h}  =.49 


•  Level  3:  Variables  predominantly  loaded  on  the  first  factor 

The  eigenvalues  indicate  the  total  variance  explained  by  each  factor.  One  can  readily 
see  that  our  different  levels  of  structure  complexity  would  affect  the  divergence  of  the 
eigenvalues,  with  the  simplest  structure  producing  the  largest  divergence.  The  three 
levels  of  structure  complexity  were  chosen  to  investigate  the  impact  of  structure 
complexity  as  manifested  in  eigenvalue  divergence.  In  order  to  quantify  Kaisers ’s 
subjective  description  of  structure  complexity,  we  proposed  using  the  ratio  of  highest 
to  lowest  eigenvalue  of  each  experimental  factor  pattern.  We  will  refer  to  this  value 
as  the  stability  ratio.  Since  eigenvalues  provide  important  information  on  the  validity 
and  strength  of  a  factor,  varying  stability  ratios  will  hopefully  provide  insight  as  to 
each  criterion’s  ability  to  restore  this  information  lipon  factor  pattern  rotation.  It  was 
noted  in  chapter  2  that  Kaiser  did  not  incorporate  eigenvalue  recovery  as  a  measure 
of  effectiveness  for  normal  varimax  rotation.  For  that  matter,  varimax  seemed  to 
have  a  leveling  effect  on  eigenvalue  divergence.  Our  range  of  structure  complexity 
provides  a  range  of  eigenvalue  dispersion  for  assessing  rotational  properties.  Notice 
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at  each  level  of  structure  complexity,  the  initial  nine  experimental  factor  patterns 
exhibit  three  different  average  communalities  of  .81,  .64,  and  .49.  This  will  prov’de 
insight  into  the  influence  of  structure  complexity,  communality  and  the  interaction 
of  both. 

As  shown  in  Tables  3.5  thru  3.10,  each  of  the  initial  nine  experimental  patterns 
were  then  perturbed  across  both  the  factors  and  the  variables. 

Table  3.5.  Level  1  Perturbed  Across  Factors 


Pattern  11 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

0 

.6 

0 

0 

0 

.6 

0 

0 

0 

.6 

0 

0 

0 

.6 

0 

0 

0 

0 

.5 

0 

0 

0 

.5 

0 

0 

0 

.5 

0 

0 

0 

.5 

Pattern  10 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

0 

.8 

0 

0 

C 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

0 

-.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

0 

.6 

0 

0 

0 

.6 

0 

0 

0 

.6 

0 

0 

0 

.6 

Pattern  12 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

0 

.6 

0 

0 

0 

.6 

0 

0 

0 

.6 

0 

0 

0 

.6 

0 

0 

0 

0 

.5 

0 

0 

0 

.5 

0 

0 

0 

.5 

0 

0 

0 

.5 

0 

0 

0 

0 

.4 

0 

0 

0 

.4 

0 

0 

0 

.4 

0 

0 

0 

.4 

Note  when  perturbing  across  the  factors,  each  variable  within  a  common  factor  ex¬ 
hibits  the  same  communality.  Perturbing  across  the  variables  assigns  a  different 
communality  to  each  variable  within  a  common  factor.  In  terms  of  the  three  sub¬ 
jective  levels  of  structure  complexity  defined  earlier  in  this  section,  the  structural 
complexity  is  maintained  to  allow  the  researcher  to  assess  how  eigenvalue  dispersion 
due  to  both  variable  communality  and  structure  complexity  drive  rotation  accuracy. 
For  the  purposes  of  this  effort,  rotational  accuracy  is  the  ability  of  a  rotation  crite¬ 
rion  to  recover  the  loadings,  eigenvalues  and  structure  pattern  of  each  experimental 
factor  pattern.  Measures  of  effectiveness  were  suggested  to  capture  these  properties 
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Table  3.6.  Level  2  Perturbed  Across  Factors 
Pattern  13  I  I  Pattern  14  1  i 


.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

.9 

0 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

0 

.6 

0 

0 

0 

.6 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

.8 

0 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

.7 

0 

0 

0 

0 

.6 

0 

0 

0 

.6 

0 

0 

0 

0 

.4 

0 

0 

0 

.4 

Pattern  15 

.7  0 

0 

0 

.7  0 

0 

0 

.7  0 

0 

0 

.7  0 

0 

0 

.7  0 

0 

0 

.7  0 

0 

0 

.7  0 

0 

0 

0  .6 

0 

0 

0  .6 

0 

0 

0  .6 

0 

0 

0  .6 

0 

0 

0  .6 

0 

0 

0  0 

.5 

0 

0  0 

.5 

0 

0  0 

0 

.4 

0  0 

0 

.4 

Table  3.7.  Level  3  Perturbed  Across  Factors 


Pattern  16 


.9  0  0  0 
.9  0  0  0 
.9  0  0  0 
.9  0  0  0 
.9  0  0  0 
.9  0  0  0 
.9  0  0  0 
.9  0  0  0 
.9  0  0  0 
.9  0  0  0 
.9  0  0  0 
0  .8  0  0 
0  .8  0  0 
0  0  .7  0 
0  0  .7  0 
0  0  0  .6 


Pattern  17 


.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

.8  0  0  0 

0  .7  0  0 

0  .7  0  0 

0  0  .6  0 

0  0  .6  0 

0  0  0  .5 


Pattern  18 


.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
.7  0  0  0 
0  .6  0  0 
0  .6  0  0 
0  0  .5  0 
0  0  .5  0 
0  0  0  .4 


Table  3.8.  Level  1  Perturbed  Across  Factors  And  Variables 


Pattern  19 

Pattern  20 

.9  0  0  0 

o 

o 

o 

00 

.8  0  0  0 

.7  0  0  0 

.7  0  0  0 

.6  0  0  0 

.6  0  0  0 

.5  0  0  0 

0  .8  0  0 

0  .7  0  0 

0  .7  0  0 

0  .6  0  0 

0  .6  0  0 

0  .5  0  0 

0  .5  0  0 

0  .4  0  0 

0  0  .7  0 

0  0  .6  0 

0  0  .6  0 

0  0  .5  0 

0  0  .5  0 

0  0  .4  0 

0  0  .4  0 

0  0  .3  0 

0  0  0  .6 

0  0  0  .5 

0  0  0  .5 

0  0  0  .4 

0  0  0  .4 

0  0  0  .3 

0  0  0  .3 

0  0  0  .3 

Pattern  21 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

0 

.4 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

.3 

Table  3.9.  Level  2  Perturbed  Across  Factors  And  Variables 


Pattern  22 


.9 

0 

0 

0 

.8 

0 

0 

0 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

0 

.8 

0 

0 

0 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

0 

.7 

0 

0 

0 

.6 

0 

0 

0 

0 

.6 

0 

0 

0 

.5 

Pattern  23 

.8 

0 

0 

0 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

0 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

0 

A 

0 

0 

0 

.3 

Pattern  24 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

0 

.4 

0 

0 

0 

.3 
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Table  3.10.  Level  3  Perturbed  Across  Factors  And  Variables 


Pattern  25 

.9 

0 

0 

0 

.8 

0 

0 

0 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

0 

.8 

0 

0 

0 

.7 

0 

0 

0 

0 

.7 

0 

0 

0 

.6 

0 

0 

0 

0 

.6 

Pattern  27 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

0 

.3 

Pattern  26 

.8 

0 

0 

0 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

.4 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

.3 

0 

0 

0 

0 

.7 

0 

0 

0 

.6 

0 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

0 

0 

0 

.4 

and  will  be  defined  in  a  later  section.  Further,  the  mean  and  standard  deviation  of 
these  measures  of  effectiveness  will  be  recorded  over  100  experiments  for  each  of  the 
thirty-six  populations  corresponding  to  the  experimental  factor  patterns. 

Finally,  the  set  of  experimentad  patterns  was  further  expanded  by  randomly 
adding  nuisance  factors,  ramging  between  .64  and  .01,  to  variables  of  the  perturbed 
factor  patterns.  This  hcis  the  effect  of  inflating  the  communalities  of  the  ccrrespbhH^ 
ing  variables.  These  additionad  experimental  factor  patterns  are  shown  in  Tables  3.11 
thru  3.13. 

Each  theoretical  factor  pattern  was  analyzed  over  sample  sizes  of  17,  32,  160 
and  500.  Rather  than  determine  the  improvement  in  factor  analysis  effectiveness  as 
sample  size  increased,  we  elected  to  explore  the  minimum  threshold  needed  to  facil¬ 
itate  reasonably  accurate  factor  analysis.  The  flow  diagram  in  figure  3.1  illustrates 
a  general  overview  of  the  approach  utilized  in  the  analysis  of  each  theoretical  factor 
pattern.  The  following  section  will  address  each  step  of  this  approach  in  more  detail. 
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Table  3.11.  Level  1  Perturbed  And  Nuisance  Loadings 


Pattern  28 

.9 

0 

0 

0 

.8 

0 

.2 

0 

.7 

.6 

0 

0 

.6 

0 

.4 

0 

0 

.8 

.3 

0 

.5 

.7 

0 

0 

0 

.6 

0 

.2 

.2 

.5 

0 

0 

0 

0 

.7 

0 

.5 

0 

.6 

0 

0 

0 

.5 

0 

.2 

0 

.4 

0 

0 

0 

0 

.6 

0 

.4 

0 

.5 

.1 

0 

0 

.4 

0 

.2 

0 

.3 

Pattern  29 

.8 

0 

c 

.6 

.7 

0 

0 

0 

.6 

.5 

0 

0 

.5 

0 

0 

0 

.5 

.7 

0 

0 

0 

.6 

0 

0 

0 

.5 

0 

.1 

0 

.4 

.3 
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Table  3.12.  Level  2  Perturbed  And  Nuisance  Loadings 
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Figure  3.1.  Methodology 
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Table  3.13.  Level  2  Perturbed  And  Nuisance  Loadings 
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3.2  Data  Generation 

This  section  begins  by  outlining  the  procedure  for  deriving  a  covariance  matrix 
from  each  of  the  third-six  theoretical  factor  patterns.  Recall  the  basic  factor-analytic 
model  introduced  in  chapter  two, 


(3.1) 

where 

X  is  a  p  X  1  vector  of  observed  responses, 

A  is  a  p  X  9  matrix  of  unknown  constants  (factor  loadings), 

/  is  a  9  X  1  vector  of  unobservable  variables  (common  factors) 


and 
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e  is  a  p  X  1  vector  of  unobservable  variables  (unique  factors). 

Specifically, 

All  .  ...  Ai, 

.  A,^ 

Api  .  ...  Xpq 

Also  recall  that  the  j  unique  factors  consist  of  the  variance  of  each  variable  not 
explained  by  any  of  the  common  factors.  It  is  generally  assumed  that  the  unique 
parts  of  each  variable  are  uncorrelated.  Further,  the  unique  parts  are  uncorrelated 
with  the  common  parts 

^'i  0  ...  0 

0  ’Pa  .  .  .  3 

=  ee^  =  = 

0  0  .  .  . 

These  assumptions  imply  that  the  covariance  matrix  of  X  C2m  be  written  as 

+  4-.  (3.2) 


where 


4’  is  as  previously  defined, 

A  is  the  original  experimental  factor  loadings  matrix, 


and 


1 

$21  1 
$31  $32  1 


$il  $>2  •  •  •  $«,»-!  f  J 


where  $  gives  the  covariance  between  the  common  factors.  When  it  is  assumed  that 
the  factors  are  uncorrelated,  we  have 


$  =  /, 


hence 


(3.3) 


=  AA^  +  $. 


(3.4) 


Thus  a  population  covariance  matrix  can  be  derived  by  multiplying  the  theoretical 
factor  pattern  by  its  transpose  and  adding  the  diagonal  matrix  of  uniqueness  values 
for  each  variable.  Since  the  communality  (that  pwt  of  the  variance  accounted  for  by 
the  common  factors)  is 


The  uniqueness  of  each  vjjrlahifc  in  a  givcu  iLeC-ittioa!  matrix  can  he  c?lciilated  as 


«.  =  1  -  h?  (3.6) 

Therefore, 

B..  =  AA’'4  (l-EA?)  .  (3.7) 

■»  j 

The  next  step  in  the  experimental  procedure  was  to  generate  JV(sample  size)  ' 

sample  vectors  of  length  16  (number  of  variables).  Since  the  individual  components  of 
each  sample  vector  are  obviously  not  independent, we  generated  each  random  vector 
from  a  joint  (multivariate  normal)  distribution  to  form  a  vector  of  correlated  random 
norm2J  vwates.  Each  covariance  matrix  is  positive  definite  and  can  be  factored  into 
an  upper  and  lower  triangular  matrix  using  Choleski  decomposition 

E  =  C  (3.8) 

For  a  more  detailed  mathematical  explanation  of  Choleski  decomposition,  see  (Bur¬ 
den  £ind  Faires,1989:370).  After  the  covariance  matrix  was  factored,  we  generated 
random  multivariate  normal  deviates 


Xi  =  j2CiiZiu 

i=i 


where 

t  = 


and 


(3.9) 


X  =  {Xu  ..X,f  ~  JV,(0,  E).  (3.10) 

A  FORTRAN  program  (see  appendix  A)  utilizing  routines  CHFAC  (IMSL, 
1987:1144)  and  RNMVN  (IMSL, 1987:1033)  was  written  to  read  a  selected  covauri- 
ance  matrix,  perform  Choleski  decomposition  and  return  100  sets  of  fV(sample  size) 
1  X  16  multivariate  normal  deviate  vectors.  These  data  sets  were  then  factor  an¬ 
alyzed  using  the  SAS  (see  appendix  C)  principal  components  method.  SAS  was 
used  because  we  experienced  problems  with  the  FACTR  routine  (IMSL,  1987:647) 
returning  consistent  results.  The  Monte  Carlo  technique  was  implemented  in  our 
main  FORTRAN  program  (see  appendix  D)  which  used  the  FROTA  routine  (IMSL, 
1987:656)  to  return  rotated  factor  patterns  for  both  the  raw  and  normal  veirimax 
criterion.  There  were  also  problems  with  the  FROTA  routine  in  that  the  columns 
of  the  rotated  output  were  not  in  the  correct  order  with  respect  to  the  eigenvalues. 
Because  of  the  greater  flexibility  this  routine  provided,  we  decided  to  use  it  and 
createl  a  sort  routine  in  our  main  program  to  rewrite  the  common  factors  of  each 
rotated  factor  pattern  in  the  correct  (largest  eigenvalues  first)  order.  Theoretical 
factor  pattern  characterization  parameters,  rotation  measures  of  effectiveness,  and 
o'!  statistics  were  calculated  in  this  progreim. 
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3.3  Pattern  Characterization 


Selecting  a  method  that  quantifies  the  fundamental  features  of  a  large  group 
of  theoretical  patterns  over  a  large  range  of  loading  structures  and  communalities 
was  a  difficult  process.  For  this  effort  the  researcher  relied  primarily  on  three  such 
metrics.  They  were  the 

•  Stability  Ratio 

•  Complexity  index 

•  Uniqueness  index 

The  stability  ratio  concept  was  proposed  because  it  mathematically  separated  the 
theoretical  factor  patterns  into  three  levels  of  complexity  based  upon  eigenvaJue 
divergence.  Patterns  where  most  of  the  variables  load  on  one  factor  will  display  a 
very  large  ratio  of  highest  to  smallest  eigenvalue,  thereby  incurring  a  high  stability 
ratio.  Conversely,  theoretical  factor  patterns  with  equal  variable  loading  will  have  a 
stability  ratio  close  to  1.  Used  in  this  manner,  the  stability  ratio  will  provide  a  means 
of  quantifying  Kaiser’s  concept  of  structure  complexity.  Since  eigenvdue  divergence 
is  a  function  of  the  factor  pattern  columns,  we  will  call  this  component  of  structure 
complexity  the  column  effect. 

^min 

In  addition  to  eigenvalue  divergence.  There  are  several  promising  methods 
for  quantifying  factor  pattern  complexity.  Bauer  explains  complexity  in  terms  of 
the  difficulty  for  a  factorization  technique  to  extr^lct  the  first  factor  over  the  second 
(Bauer,  1981:39).  In  other  words,  the  total  variance  explained  by  the  first  two  factors 
are  so  close  in  value,  the  extraction  algorithm  has  difficulty  discerning  between  the 
two.  He  proposed  a  complexity  index  combining  two  structure  parts  that  he  called 


(3.11) 


/ 


i 

1 


3-16 


•  Complication  due  to  structure 

•  Complication  due  to  uniqueness 
The  first  component  of  the  complexity  index  t2dces  the  form 

Ef=i  HU 

p 

This  term  (structural  complexity)  suggests  that  factor  patterns  with  variables  loaded 
equaJly  on  all  variables  will  exhibit  large  complication  due  to  structure  with  a  weak 
upper  bound  of  1,  while  patterns  with  all  variables  loaded  on  one  factor  will  display 
very  low  complication  due  to  structure  with  a  lower  bound  of  0.  Inspecting  the 
formulation,  we  can  see  that  this  component  is  a  function  of  the  factor  pattern  rows 
and  columns.  We  will  call  this  component  of  structure  complexity  the  geometry 
effect.  The  second  part  of  Bauer’s  complexity  index, 

hi 
P 

is  the  average  uniqueness  of  the  experimental  factor  pattern.  Simply  put,  the  lower 
the  uniqueness  of  a  given  variable  the  higher  the  variance  (communality)  explained 
by  the  common  factors.  With  less  vuiance  due  to  uniqueness  (error),  a  rotation 
technique  has  a  better  chance  of  recovering  the  representative  factor  pattern.  We 
will  refer  to  uniqueness,  a  function  of  the  rows  (variables),  as  the  row  effect.  In  an 
effort  to  isolate  these  two  effects,  we  will  perform  separated  calculations  for  these 
two  parts.  A  primary  objective  of  this  effort  will  be  to  determine  if  any  single  effect 
or  interaction  of  effects  can  provide  accurate  prediction  of  factor  pattern  behavior. 


(3.13) 


(3.12) 
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S.4  Measures  Of  Effectiveness 

Three  priiriaxy  areas  were  addressed  to  explore  the  accuracy  of  the  two  varimax 
criteria. 

•  The  ability  to  recover  the  experimental  factor  pattern  structure 

•  The  ability  to  recover  the  variable  loadings  for  the  experimental  factor  pattern 

•  The  ability  to  recover  the  total  variance  explained  by  each  factor  (eigenvalue) 
in  the  experimented  factor  pattern 

Each  observed  rotated  structure  was  compared  to  its  associated  experimental  struc¬ 
ture  to  determine  the  number  of  times  our  observed  pattern  loaded  a  variable  on  the 
same  factor  as  the  experimental  pattern.  This  was  accomplished  by  assigning  a  value 
of  1  to  the  most  significant  factor  loading  of  every  VMiable  in  ejich  experimental  fac¬ 
tor  pattern  and  a  zero  value  to  all  other  loadings.  This  same  binaxy  transformation 
was  also  performed  on  each  rotated  sample  factor  pattern.  The  experimental  struc¬ 
tures  were  then  compared  to  the  Af=24  permutations  of  the  j=4  factor  columns  of 
its  respective  rotated  solution,  scoring  the  highest  number  of  achieved  matches.  The 
scoring  calculation  is 


max  tr 


(3.14) 


where 

Ae  is  the  experimented  factor  pattern 
and 

An  (n=l,...,24)  are  the  permuted  rotated  factor  patterns. 

The  permutations  were  performed  to  ensure  the  study  compared  only  the  best  possi¬ 
ble  form  of  each  rotation  criterion.  Additionally,  this  same  procedure  was  conducted 
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on  each  extracted  unrotated  factor  pattern  to  contrast  its  accuracy  to  that  of  the 
two  varimax  rotation  criterion 

Variable  loading  recovery  w<is  measured  by  calculating  the  root  mean  square 
residuals  between  each  rotated  variable  loading  and  those  of  its  parent  experimental 
factor  pattern  as 


ziL,  (A^  -  xur 

pq 


(3.15) 


where 


pq  is  the  told  number  of  factor  loadings, 


are  the  experimental  factor  pattern  loaqings 


and  I  . 

) 

=  are  the  best  permuted  factor  pattern  loadings. 

Eigenvalue  recovery  was  measured  in  a  fashion  simil2ur  to  that  of  the  vuiable 
loadings.  We  calculated  the  root  mean  square  residuals  of  the  eigenvalues  between 
each  rotated  variable  loading  and  its  parent  experimental  factor  pattern.  This  is 
calculated  as 


m 

q 


(3.16) 

(3.17) 


where 


q  is  the  total  number  of  eigenvalues, 

Lj  are  the  experiment£j  factor  pattern  eigenvalues 
and 

LJ  are  the  best  permuted  factor  pattern  eigenvalues. 

It  must  be  noted  that  in  each  of  the  residual  calculations,  the  rotated  factor  pattern 
was  the  permuted  pattern  that  produced  the  highest  matching  score.  Again,  this  was 
to  ensure  that  residuals  were  calculated  for  the  best  possible  rotated  representation. 
All  measures  of  effectiveness  were  averaged  over  N=100  data  sets  from  thirty-six 
different  populations  corresponding  to  each  experimental  factor  pattern  to  establish 
a  grand  mean  for  all  measures  of  effectiveness. 

5.5  Regression  Analysis 

Several  regression  studies  will  be  conducted  to  determine  if  rotated  pattern 
matching  score,  factor  loading  error  and  eigenvalue  error  can  be  predicted  as  func¬ 
tions  of  sample  size,  stability,  uniqueness  and  complexity.  Each  of  our  measures 
of  merit  were  taken  as  the  grand  mean  of  100  iterations  for  the  different  experi¬ 
mental  structure-sample  size  combinations.  Two  types  of  regression  models  will  be 
investigated.  _  ' 

1.  A  linear  regression  model  for  predicting  measures  of  effectiveness  using  a  step¬ 
wise  procedure.  Three  formulations  of  this  model  will  include  pattern  matching 
score,  root  mean  square  residual  loadings  (RMSR),  and  root  mean  square  resid¬ 
ual  eigenvedues  (RMSER)  as  response  vjiriables.  Each  response  will  be  modeled 
as  a  linear  function  of  stability  ratio,  uniqueness  index,  complexity  index  and 
all  possible  multiplicative  interaction  terms. 
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2.  A  nonlinear  model  will  also  be  attempted  for  predicting  measures  of  effective¬ 
ness  using  a  stepwise  procedure  to  fit  a  Cobb-Douglas  function.  This  will  enable 
us  to  capture  any  nonlinearities  greater  than  first  or  second  order  that  may 
be  present  in  the  data.  This  model  will  also  include  three  formulations  using 
pattern  matching  score,  RMSR,  and  RMSER  as  response  variables.  The  inde¬ 
pendent  variables  will  include  stability  ratio,  uniqueness  index  and  complexity 
index  as  independent  variables. 

The  general  approach  for  the  regression  analysis  will  be  to  hrst  attempt  a  linear 
model  of  each  response  V2u:iable  for  the  smallest  sample  size,  17.  Our  criteria  for  an 
acceptable  model  will  be  any  one  that  explains  80  %  of  the  variance  of  the  response 
V2uiable  as  indicated  by  the  adjusted  value.  If  this  model  is  un£u:ceptable,  the 
sample  sizes  will  be  successively  increased  until  the  largest,  500,  has  been  modeled. 
If  according  to  our  criterion,  the  model  is  still  unacceptable,  we  will  attempt  to  fit 
a  Cobb-Douglas  function  to  the  response  determined  by  the  smallest  sample  size. 
This  procedure  will  also  bring  in  larger  samples  until  all  sample  sizes  are  exhausted 
or  an  acceptable  model  is  obtained. 

S.6  Factor  Analysis 

Finally,  our  analysis  will  conclude  with  preliminary  factor  analysis  on  three 
data  sets  consisting  of  the  following  groups  of  vwables. 

1.  The  set  of  vuiables  measuring  matching  scores  for  the  raw  and  normal  varimax 
factor  patterns,  and  the  unrotated  factor  pattern. 

2.  The  set  of  variables  measuring  RMSR  for  the  raw  varimax,  normal  varimax 
and  unrotated  factor  patterns. 

3.  The  set  of  variables  measuring  RMSER  for  the  raw  vatrimax,  normal  varimax 
and  unrotated  factor  patterns. 
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In  addition  to  generating  factor  patterns,  we  will  also  examine  some  two-factor  plots. 
This  analysis  will  a  visual  perspective  of  the  interrelationship  of  each  experimental 
factor  pattern.  In  order  to  remain  consistent,  sample  size  corresponding  to  the  data 
set  yielding  the  best  regression  model  for  each  experimental  factor  pattern  will  be 
the  one  factor  analyzed. 

5.7  Summary 

This  concludes  the  methodology  discussion  for  this  research  effort.  This  chap¬ 
ter  covered  data  generation,  the  Monte  Carlo  approach,  independent  predictor  cal¬ 
culations  and  response  measures  of  effectiveness  calculations.  The  next  chapter  will 
detail  the  results  of  this  approach. 
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IV.  Results  and  Conclusions 

4.1  Monte  Carlo  Approach 

The  Monte  Carlo  method  was  applied  to  assess  the  accuracy  and  associated 
properties  of  the  raw  and  normal  varimax  criterion  for  rotation  in  factor  analysis. 
In  all,  three  different  levels  of  structure  complexity  were  used: 


•  Level  1:  Variables  loaded  equally  on  all  four  factors 

•  level  2;  Variables  predominantly  loaded  on  the  first  two  factors 

•  level  3:  Variables  predominantly  loaded  on  the  first  factor 


Each  level  of  structure  complexity  was  investigated  over  a  range  of  average  com¬ 
monality  and  nuisance  loadings.  As  defined  in  the  previous  chapter,  several  factor 
pattern  descriptor  variables  and  measures  of  effectiveness  were  proposed  to  predict 
rotation  criterion  performance.  Recall  that  we  are  defining  factor  pattern  complexity 
in  terms  of  row,  column  and  geometry  effects  and  that  these  effects  will  be  estimated 
as  a  function  of  the  predictors.  Our  set  of  experimentsil  factor  patterns  were  con¬ 
trived  to  display  a  range  of  each  effect.  In  Figures  4.1,  4.2  and  4.3  we  have  sorted 
the  set  of  experimental  factor  patterns  in  ascending  order  of  stability  ratio,  unique- 
.ness  index  and  complexity  index  to  illustrate  the  experimental  range  of  each  effect.; 
Based  on  the  analysis  of  these  metrics,  several  conclusions  have  been  drawn.  1 


4.S  Pattern  Matching 

Perhaps  one  of  the  most  important  measures  of  effectiveness  regarding  any  ro¬ 
tation  criterion  is  the  ability  to  restore  the  true  underlying  f£u:tor  pattern  structure. 
The  observed  structures  for  the  unrotated  and  both  rotated  (raw  and  normal  vari¬ 
max)  factor  patterns  were  compared  to  each  of  their  ^lssociated  experimental  factor 
patterns  to  determine  a  pattern  matching  score.  That  score  is  the  number  of  times 
the  experimental  and  observed  patterns  both  load  a  variable  on  the  same  factor. 
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EXPERIMENTAL  COMPLEXITY  RANGE 


Figure  4.3.  Experimental  Factor  Pattern  Complexity  Index  Range 

The  pattern  matching  score  was  the  highest  matching  total  recorded  for  each  of  the 
twenty-four  permutations  of  the  four  columns  in  each  observed  factor  pattern.  This 
ensures  consistent  comparison  of  the  best  possible  observed  factor  pattern  structure. 

4-S,l  Exploratory  Scatter  Plots.  Figures  4.4,  4.5  and  4.6  show  initial 
scatter  plots  of  the  matching  scores  agdnst  each  complexity  effect. 

We  can  clearly  see  from  Figure  4^5  that  matching  score  as  a  function  of  uniqueness 
displays  the  most  conclusive  relationship  of  any  predictor  variable.  Upon  closer  in¬ 
spection,  ^eir  appears  to  be  four  different  processes  taking  pl2M».  First,  there  is 
a  general  trend  tow2U'd  lower  matching  scores  for  the  observed  unrotated  and  ro¬ 
tated  factor  patterns  as  the  average  uniqueness  of  the  experimental  factor  pattern 
increases.  Second,  the  scatter  plot  converges  with  increased  uniqueness,  indicat¬ 
ing  no  difference  between  unrotated  and  rotated  matching  scores  at  high  levels  of 
uniqueness.  Furthermore,  we  can  see  that  the  raw  and  normal  varimax  rotation 
criterion  achieve  the  same  matching  score  at  all  levels  of  uniqueness.  Fineilly,  Fig- 
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Pattern  Matching  vs  Stability  Ratio 


Stability  Ratio 


Figure  4.5.  Uniqueness  Index  vs  Pattern  Matching  Score  For  Sample  Size  N=17 
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Figure  4.6.  Complexity  Index  vs  Pattern  Matching  Score  For  Sample  Size  N=17 

ure  4.5  shows  unrotated  factor  patterns  of  the  S2une  uniqueness  exhibiting  distinctly 
different  matching  scores.  The  significance  of  this  difference  decreases  as  uniqueness 
increases.  To  understand  what  is  causing  this  response,  we  must  refer  to  the  un¬ 
rotated  matching  scores  ranked  according  to  uniqueness  index  shown  in  Table  4.1. 
This  Table  shows  us  that  at  any  given  uniqueness,  0.190  for  example,  higher  stabil¬ 
ity  ratios  produce  a  higher  matching  scores  for  an  unrotated  factor  pattern.  While 
the  scatter  plots  of  stability  ratio  and  complexity  index  do  not  show  any  conclusive 
relationships,  they  do  indicate  that  there  is  no  difference  between  the  two  varimax 
criterion  in  response  to  column  or  geometry  effects 

4.2.2  Regression  Analysis.  A  regression  analysis  was  then  performed  on 
the  observed  matching  score  for  the  unrotated  and  both  rotated  factor  patterns  to 
better  understand  the  influence  of  column,  row  and  geometry  effects  as  measured  by 
the  predictor  variables.  In  2uldition,  a  successful  regression  model  will  determine  if 
pattern  matching  scores  can  be  predicted.  In  this  analysis,  pattern  matching  score 
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Structure  Stability 


Uniqueness 


90 

90 
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was  taken  as  the  grand  mean  of  100  sample  pattern  matching  scores  obtained  from 
eaw:h  experimental  structure-sample  size  combination.  Using  .80  as  the  target  ad¬ 
justed  P?  value,  we  first  performed  a  linear  regression  on  the  smallest  sample  size 
combination  (N=17)  and  incremented  the  sample  sizes  until  reaching  our  target.  If 
the  largest  sample  size  combination  {N=500)  failed  to  reach  the  target,  the  proce¬ 
dure  was  repeated  with  a  Cobb-Douglas  type  function.  In  the  case  of  factor  pattern 
matching  scores,  a  satisfactory  linear  regression  model  for  each  observed  factor  pat¬ 
tern  was  obtained  with  the  sm£Jlest  sample  size.  The  independent  variables  in  each 
model  consisted  of  the  stability  ratio,  uniqueness  index,  complexity  index,  all  two 
variable  interaction  terms  and  the  three  variable  interaction  term.  Table  4.2  summa¬ 
rizes  the  adjusted  .ft*,  mean  square  error,  entering  variable  coefficients  and  variable 
significance  for  each  model. 

According  to  the  adjusted  ft*  and  mean  square  errors,  the  three  models  appear 
to  predict  matching  scores  reasonably  well.  The  residual  plots  (Appendix  E)  also 
indicate  a  high  degree  of  model  aptness.  Note  in  Table  4.1  that  Uniqeness^  is  the 
second  most  significant  independent  veu’iable  in  each  model.  However,  in  the  model 
for  unrotated  matches,  Uniqueness^  is  much  less  significant  than  in  the  models  for 
our  raw  and  normal  varimax  criterion.  Further,  the  significance  of  this  particular’ 
independent  variable  is  nearly  equal  for  the  two  rotation  criterion.  In  fact,  the 
raw  and  normal  varimaoc  models  are  very  similar  in  terms  _of  main  and  two-fau:tor 
interaction  effects.  Also  note  that  Siamlity  is  nearly  as  significant  as  Uniqueness^ 
in  the  unrotated  model  but  very  smadl  relative  to  Uniqueness^  in  either  rotated 
model.  The  coefficients  of  Uniqueness^  and  Stability  in  each  model  adso  indicate  that 
matching  scores  for  rotated  factor  patterns  are  influenced  by  row  effects  (uniqueness) 
to  a  greater  extent  than  unrotated  factor  patterns.  Conversely,  matching  scores  for 
unrotated  fau:tor  patterns  are  influenced  by  column  effects  (stability)  much  more 
than  the  rotated  factor  patterns.  Also  shown  are  very  large  negative  coefficients  for 
complexity  in  all  three  models.  Evidently  complexity  in  terms  of  geometry  has  a  luge 
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Table  4.2.  Linear  Regression  Models  For  Factor  Pattern  Matching  Score 


Unrotated 


Raw 


Normal 


Variables 

Coefficients 

t- value 

Const 

11.707 

26.96 

Uniq* 

-7.230 

-6.70 

Stab 

0.408 

5.33 

Comp 

-65.006 

-  -3.05 

Stab'^ 

-0.005 

-2.84 

ST*Un 

-0.266 

-2.57 

=.88 

MSB  =0.614 

Const 

16.644 

65.63 

Uniq^ 

-13.014 

-22.17 

Comp 

-251.750 

-4.61 

Stab 

-0.032 

-2.34 

Comp^ 

5639.798 

2.32 

=.95 

MSB  =0.396 

Const 

16.675 

65.32 

Uniq^ 

-13.190 

-22.43 

Comp^ 

9619.153 

3.17 

Comp 

-237.73 

-3.09 

Stab 

-0.032 

-2.37 

St  *  Un\*  Co 

153.611 

2.29 

st*cb 

-115.069 

-2.21 

W  =.^5 

MSB  =0.386 
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influence  on  factor  pattern  recovery.  Since  geometry  can  be  considered  a  combination 
of  the  row  and  column  effects  that  have  already  been  found  to  be  significant  in  each 
model,  this  makes  intuitive  sense.  It  is  interesting  that  stability  and  uniqueness  are 
present  as  an  interaction  term  in  the  unrotated  model.  The  results  of  this  regression 
analysis  seems  to  support  our  initial  conclusions  b^ed  upon  the  exploratory  scatter 
plots. 

4.2.S  Factor  Analysis.  A  factor  analysis  was  performed  using  the  un¬ 
rotated,  raw,  and  normal  factor  scores  as  our  observed  variables.  Three  variables 
limited  our  dimensionality  to  three  possible  latent  factors.  F2M:tor  an2ilysis  was  ac¬ 
complished  to  determine  if  our  initial  conclusions  about  the  relationship  between 
pattern  recovery  and  the  three  complexity  effects  were  correct.  If  these  conclusions 
are  in  error,  factor  analysis  can  help  identify  the  presence  of  other  effects  not  cap- 
ttired  by  our  predictor  variables.  After  extracting  the  common  factors,  the  factor 
pattern  was  rotated  using  the  normal  varimax  criterion.  This  rotated  factor  pattern 
is  illustrated  in  Table  4.3. 

Table  4.3.  Rotated  Factor  Pattern  For  Matching  Score 


fi 

/» 

h 

Unrotated 

.422 

.906 

.000 

Raw 

.906 

.422 

-.016 

Normal 

.906 

.422 

.016 

The  structure  indicated  by  the  bold  faced  factor  loadings  shows  the  observed  match¬ 
ing  scores  for  the  raw  and  normal  varimax  criterion  to  be  strongly  influenced  by 
the  same  underlying  process.  Observed  matching  scores  for  the  unrotated  factor 
pattern  are  influenced  just  as  strongly  by  a  different,  independent  process.  It  would 

be  reasonable  to  infer  that  uniqueness  is  the  underlying  process  associated  with  the 

• 

rotated  matching  scores,  while  stability  ratio  is  a  similar  underlying  process  for  Un¬ 
rotated  matching  scores.  The  two-  factor  plot  (Appendix  F)  graphically  illustrates 
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this  relationship.  The  cluster  comprising  group  I  are  characterized  by  high  stability 
ratios,  while  that  of  group  II  are  characterized  by  very  low  average  uniqueness. 

4-8.4  Conclusions.  Based  upon  the  preceding  analysis  we  can  conclude 
That  there  is  no  difference  between  the  ability  of  the  raw  or  normal  varimax  rotation 
criterion  to  restore  a  known  factor  pattern  (of  the  type  we  sampled  from).  Also,  the 
difference  between  rotated  and  unrotated  pattern  recovery  is  negligible  at  high  levels 
of  average  uniqueness  in  the  patterns.  Finally,  we  saw  that  stability  ratio  heavily 
influenced  the  unrotatcd  factor  pattern,  while  average  uniqueness  influenced  the 
rotated  factor  patterns.  In  all  cases,  the  number  of  pattern  matches  were  predictable 
with  a  linear  regression  model  at  a  very  small  sample  size. 

4-3  Factor  Loading  Residuals 

In  addition  to  pattern  matching,  our  investigation  also  included  each  rotation 
criterion’s  ability  to  recover  the  factor  loading  of  each  experimental  factor  pattern. 
To  address  this  performance  area,  we  proposed  using  the  root  mean  square  residuals 
(RMSR)  of  the  observed  factor  loadings  as  a  measure  of  merit.  RMSR  was  calculated 
for  the  permuted  f2w:tor  pattern  that  yielded  the  best  pattern  matching  score. 

4-3.1  Exploratory  Scatter  Plots.  Figures  4.7,  4.8  and  4.9  show  initial 
scatter  plots  for  RMSR  against  each  complexity  effect.  Unfortunately,  none  of  these 
scatter  plots  indicate  any  conclusive  relationship  between  factor  loading  recovery 
and  the  row,  column  or  geometry  effects.  We  can  see  that,  regardless  of  the  effect, 
there  is  very  little  difference  between  residuals  of  the  observed  factor  patterns  for 
the  unrotated,  raw  varimax  or  normal  varimax.  The  scatter  plots  for  stability  and 
uniqueness  show  a  very  slight  trend  in  which  the  residuals  decreaise  with  increasing 
complexity  in  terms  of  column  and  row  effects  respectively.  Intuitively,  one  would 
expect  to  see  the  opposite  trend.  A  regression  analysis  was  conducted  to  see  if 
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we  could  gain  further  insight  into  the  underlying  process  affecting  observed  factor 
pattern  loading  residuals. 

,1 
0.8 
0.6 

RMSR 
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Stability  Ratio 

Figure  4.7.  Stability  Ratio  vs  Root  Mean  Square  Loading  Residuals  For  Small  Sam¬ 
ple  Size  N=17 

4.S.S  Regression  Analysis,  As  in  the  regression  analysis  conducted  for 
pattern  matching  scores,  RMSR  was  taken  as  the  grand  mean  of  100  RMSR  samples 
obtained  from  each  experimental  structure-sample  size  combination.  Again  using  .80 
as  the  target  adjusted  R’  value,  we  first  performed  a  linear  regression  on  the  smallest 
sample  size  combination  and  incremented  the  sample  sizes  until  reaching  the  target 
value.  If  the  largest  sample  size  combination  failed  to  reach  the  taurget,  the  procedure 
was  repeated  with  a  Cobb-Douglais  type  function.  In  the  case  of  unrotated  factor 
pattern  RMSR,  a  satisfactory  linear  regression  model  was  obtauned  with  the  smaillest 
sample  size.  As  for  RMSR  aissociated  with  the  rotated  criterion,  we  were  unable  to 
aichieve  the  desired  aidjusted  R*  with  the  smallest  sample  size  combination,  and  saw 
no  improvement  at  ainy  of  the  lairger  sample  sizes.  When  attempting  to  fit  a  Cobb- 
Douglas  function,  we  observed  adjusted  R^  vadues  lower  than  had  been  achieved  with 


RMSR  vs  Stability  Ratio 
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RMSR 


RMSR  vs  Uniqueness  Index 


Figure  4.8.  Uniqueness  Index  vs  Root  Me2Ln  Square  Loading  Residuals  For  Small 
Sample  Size  N=17 
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Figure  4.9.  Complexity  Index  vs  Root  Mean  Square  Loading  Residuals  For  Small 
Sample  Size  N=17 
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the  linear  model.  Table  4.4  summarizes  the  adjusted  mecin  square  error,  entering 
variable  coefficients  and  variable  significance  for  each  linear  model.  The  independent 
variables  in  each  model  consisted  of  the  stability  ratio,  uniqueness  index,  complexity 
index,  all  two  variable  interaction  terms  and  the  three  variable  interaction  term. 


Table  4.4.  Linear  Regression  Models  For  Root  Mean  Square  Residuals 


Unrotated 


Raw 


NormaJ 


Variables 

Coefficients 

t-value 

Const 

0.552 

35.64 

Uniq 

-0.238 

-8.77 

Stab 

-0.006 

-4.71 

Comp 

-65.006 

-3.05 

ST*Un 

0.006 

2.66 

Bi}  =.81 

MSB  =0.0003  1 

Const 

0.468 

30.57 

Uniq 

-0.118 

-4.40 

Stab 

-0.004 

-3.31 

ST*Un 

0.005 

-2.20 

=.54 

MSB  =0.0003 

Const 

0.448 

42.19 

Uniq 

-0.087 

-4.93 

StalP 

-0.0001 

-4.02 

=.53 

MSB  =0.0003 

According  to  the  adjusted  and  mean  square  errors,  the  unrotated  model 
appears  to  predict  RMSR  very  well.  The  rotated  models  show  only  a  fair  level 
of  RMSR  prediction.  Even  so,  the  residual  plots  (Appendix  G)  indicate  a  high 
degree  of  aptness  for  all  three  models.  Note  in  Table  4.4  that  a  Uniqeness  term 
is  lagain  the  second  most  significant  independent  variable  in  each  model.  However, 
in  \the  model  for  unrotated  matches.  Uniqueness  is  twice  as  significant  as  in  the 
models  for  our  raw  and  normal  varimax  criterion.  Perhaps  this  variable  has  a  greater 
influence  on  the  unrotated  residuals,  hence  providing  a  better  fit  with  the  linpAr 
model.  The  significance  of  the  Stability  variable  is  approximately  equal  in  each 
model.  The  coefficients  of  Uniqueness  terms  in  each  model  indicate  residuals  for 
rotated  factor  patterns  are  influenced  by  row  effects  (uniqueness)  to  a  greater  extent 
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Table  4.5.  Rx)tated  Factor  Pattern  For  Root  Mean  Square  Residuals 


/i 

h 

/s 

Unrotated 

.497 

.866 

.033 

Raw 

.865 

.496 

-.073 

Normal 

.836 

.518 

.179 

than  unrotated  factor  pattern.'i.  This  difference  is  only  relative,  since  the  influence 
in  any  specific  model  is  very  small.  According  to  the  coefficients  for  the  stability 
terms,  influence  due  to  column  effects  (stability)  is  also  very  small.  In  every  model, 
the  coefficients  of  both  variables  have  negative  values.  This  supports  our  initicJ 
scatter  plot  observations  where  we  detected  a  slight  reduction  in  all  residuals  as 
uniqueness  and  stability  mcreased. 

4.S.S  Factor  Analysis.  A  factor  analysis  was  performed  using  the  unro¬ 
tated,  raw  and  normal  loading  residuals  as  our  observed  variables.  Three  variables 
limited  our  dimensionality  to  three  possible  latent  factors.  Since  the  results  of  the 
scatter  plots  and  regression  analysis  were  largely  inconclusive,  a  factor  anadysis  was 
done  to  perhaps  clarify  the  relationship  underlying  factor  loading  generation.  Af¬ 
ter  extracting  the  common  factors,  the  factor  pattern  was  rotated  using  the  normal 
varimax  criterion.  This  rotated  factor  pattern  is  illustrated  in  Table  4.5. 

The  structure  indicated  by  the  bold  faced  factor  loadings  shows  the  observed 
loading  residuals  for  the  raw  and  normal  varim20c  criterion  to  be  strongly  influenced 
by  the  same  underlying  process.  Observed  residuals  for  the  unrotated  factor  pattern 
are  influenced  just  as  Wrongly  by  a  different,  independent  process.  Recall  that  this 
is  the  same  structure  pattern  identified  in  the  factor  analysis  for  factor  pattern 
matching  score.  Notice,  however,  the  significance  of  these  loadings  has  decre£ised.  A 
reduction  in  the  influence  of  column  and  row  effects  has  thus  far  been  observed  when 
comparing  the  exploratory  plots  and  regression  models  of  the  loading  residuals  to 
those  of  the  matching  scores.  As  in  the  factor  analysis  for  factor  pattern  matching 
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score,  it  would  be  reasonable  to  infer  that  uniqueness  is  still  the  underlying  process 
associated  with  the  loading  residuals  of  our  rotated  criterion,  and  stability  ratio  is 
again  the  underlying  process  for  the  unrotated  loading  residuals.  It  is  interesting  that 
while  loadings  on  the  first  two  factors  decreased,  we  saw  a  third  factor  beginning 
to  emerge.  This  may  be  in  response  to  the  geometry  effect  as  measured  by  the 
complexity  index.  In  retrospect,  a  broader  range  of  experimental  factor  pattern 
complexity  index  might  have  answered  this  question.  The  corresponding  factor  plot 
(Appendix  H).  The  absence  of  any  noticeable  clustering  of  factor  scores  would  seem 
to  indicate  a  complex  relationship  underlying  the  ability  of  unrotated  and  rotated 
varim2uc  factor  patterns  to  restore  known  experimental  factor  loadings 

4‘S.4  Conclusions.  Although  the  preceding  analysis  was  largely  inconclu¬ 
sive  ,we  can  still  make  some  broad  generalizations.  First,  according  to  our  RMSR 
criterion  there  is  little  difference  between  the  ability  of  the  unrotated  or  either  ro¬ 
tated  factor  pattern  to  restore  the  factor  loadings  of  the  experimental  factor  patterns. 
Second,  all  observed  factor  pattern  loadings  were  influenced  to  a  small  extent  by  ex¬ 
perimental  factor  pattern  stability  and  uniqueness.  Further,  the  uniqueness  influence 
was  opposite  of  what  we  expected.  While  there  appeared  to  be  an  additional  effect 
present,  we  were  unable  to  conclude  whether  this  was  the  effect  due  to  geometry. 
Finally,  a  linear  model  can  predict  the  loading  residuals  for  the  unrotated  factor 
pattern  fairly  well,  but  only  moderately  so  for  the  rotated  factor  patterns. 

4.4  Eigenvalue  Residuals 

The  final  performeince  area  explored  in  this  study  was  the  ability  of  the  ob¬ 
served  factor  patterns  to  restore  the  eigenvalues  of  each  experimental  factor  pattern. 
Recall  from  chapter  2,  Kaiser’s  normal  ^’arimax  rotation  criterion  had  a  leveling  ef¬ 
fect  on  the  eigenvalues  corresponding  to  the  rotated  factor  pattern  in  that  it  reduced 
their  divergence.  This  area  was  addressed  similar  to  the  factor  pattern  loading  issue 
by  using  the  root  mean  square  eigenvalue  residuals  (RMSER)  of  the  observed  factor 
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loadings  <is  a  measure  of  merit.  In  the  interest  < ;  consistency,  RMSEll  *vas  calculated 
for  the  same  permuted  fax:*  or  pattern  that  yielded  the  best  pattern  matching  score. 

4-4-i  Exploratory  Scatter  Plots.  Figures  4.10,  4.11  and  4.12  show  initial 
scatter  plots  for  RMSER  against  the  column  row  and  geometry  complexity  effects. 
Obviously,  the  relationship  between  eigenvalue  recovery  and  our  chosen  complexity 
effects  appears  to  be  very  complicated.  As  illustrated  in  the  scatter  plots,  there  is 
no  readily  apparent,  consistent  residual  response  with  respect  to  experimental  factor 
pattern  stability,  uniqueness  or  complexity.  It  is  also  tempting  to  conclude  in  generad 
that  there  is  no  substantial  difference  between  the  ability  of  the  unrotated,  or  either 
rotated  factor  patterns  to  recover  the  eigenvalues  of  the  experimental  factor  patterns. 
However,  the  apparent  complexity  of  the  relationship  between  our  measured  effects 
and  eigenvalue  residuals  forces  us  to  withhold  this  conclusion.  A  regression  analysis 
may  simplify  this  relationship. 

Stability  Ratio  vs  RMSER 


Figure  4.10.  Stability  Ratio  vs  Root  Mean  Square  Eigenvalue  Residuals  Seunple 
Size  N=17 
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Uniqueness  Index  vs  RMSER 


Figure  4.11.  Uniqueness  Index  vs  Root  Mean  Square  Eigenvalue  Residuals  Sample 
Size  N=17 
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Figure  4.12.  Complexity  Index  vs  Root  Mean  Square  Eigenvalue  Residuals  Sample 
Size  N=17 


4-4-^  Regression  Analysis.  Consistent  with  all  previous  regression  analysis, 
RMSER  was  taken  as  the  grand  mean  of  100  sample  RMSER  samples  obtained  from 
each  experimental  structure-sample  size  combination.  Still  using  .80  as  the  target 
adjusted  R?  value,  we  first  performed  a  linear  regression  on  the  smallest  sample  size 
combination  and  incremented  the  sample  sizes  until  reaching  the  target  value.  If 
the  largest  sample  size  combination  failed  to  reach  the  target,  the  procedure  Wcis 
repeated  with  a  Cobb-Douglas  type  function.  For  the  unrotated  and  both  rotated 
factor  patterns,  we  were  able  to  satisfactorily  model  RMSER  with  a  linear  regression 
model  using  the  smallest  structure-sample  size  combinations.  Table  4.6  summeirizes 


the  adjusted  i2®,  mean  square  error,  entering  variable  coefficients  and  variable  sig¬ 
nificance  for  each  linear  model.  The  independent  variables  in  each  model  again 
consisted  of  the  stability  ratio,  uniqueness  index,  complexity  index,  all  tvVo  variable 


inter2K:tion  terms  and  the  three  variable  interaction  term. 


Table  4.6.  Linear  Regression  Models  For  Root  Mean  Square  Eigenvalue 


Unrotated 


Raw 


Raw 


Variables 

Coefficients 

t- value 

Stab 

0.344 

8.10 

St  *Un 

-0.352 

-6.26 

Constant 

1.515 

4.28 

Stab^ 

-0.002 

-2.62 

Unique 

-1.351 

-2.23 

=.88 

MSE  =0.1859 

St  *  Un 

-0.415 

-10.59 

Stab 

-0.364 

9.26 

Constant 

0.737 

4.26 

Stab^ 

-0.002 

-2.01 

So 

Jl 

bo 

MSE  =0.2054  1 

Stab 

-0.300 

13.36 

St  *  Un 

-0.407 

-10.33 

Constant 

0.916 

8.34 

=.84 

MSE  =0.2092 

Residuals 


We  can  readily  see  from  the  values  for  adjusted  and  mean  square  error  that 
all  models  explain  most  of  the  variance  of  the  eigenvalue  residuals.  The  corresponding 
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residual  plots  (Appendix  I)  indicate  we  have  an  apt  model.  After  accounting  for 
the  relative  srhall  scale  of  the  residual  axis  and  disregarding  the  obvious  outliers, 
we  see  that  the  variance  of  the  residuals  is  fairly  constant.  A  closer  look  at  the 
entering  variables  for  each  model  reveals  several  interesting  observations.  Each  model 
incorporates  similar  independent  variables  and  these  variables  are  mostly  interaction 
terms.  This  explains  why  our  exploratory  factor  plots  were  so  difficult  to  interpret. 
Note  that  Stability  or  the  interaction  of  Stability  with  Uniqueness  axe  the  most 
significant  variables  in  each  model.  In  addition,  it  is  interesting  that  the  coefficients 
of  each  term  are  nearly  equal  in  value  but  opposite  in  sign.  Also  note  that  no  form 
of  the  complexity  index  appears  in  any  model.  Despite  these  successful  models,  the 
influence  of  column,  row  and  geometry  effects  is  still  not  clear. 

4-4-3  Factor  Analysis.  A  factor  2uialysis  was  performed  using  the  unro¬ 
tated,  raw  and  normal  eigenvalue  residuals  as  our  observed  variables.  Three  v«iri- 
ables  limited  our  dimensionality  to  three  factors.  This  analysis  should  determine  if 
a  simple  structure  is  present  in  the  residual  eigenvalue  data.  After  extracting  the 
common  factors,  the  factor  pattern  was  rotated  using  the  normal  varimax  criterion. 
This  rotated  factor  pattern  is  illustrated  in  Table  4.7. 

Table  4.7.  Rotated  Factor  Pattern  For  Root  Mean  Square  Residuals 


h 

h 

Unrotated 

.623 

.761 

.177 

Raw 

.689 

.674 

.264 

Normal 

.761 

.624 

.172 

The  structure  indicated  by  the  bold  faced  factor  loadings  is  identical  to  that 
of  the  factor  analysis  for  matching  score  and  loading  residuals.  However,  in  this  case 
we  have  a  very  complicated  structure  with  near  equal  moderate  loadings  on  adjacent 
factors.  Note  that  our  third  factor  loadings  are  becoming  more  significant  relative 
to  the  first  two  factors.  Based  upon  this  structure  and  the  many  interaction  terms 
in  the  preceding  regression  analysis,  we  can  not  identify  any  meaningful,  underlying 
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relationship  for  the  eigenvalue  residual  data.  The  absence  of  a  simple  structure  indi¬ 
cates  our  current  metrics  for  mecisuring  performance  in  terms  of  eigenvalue  residuals 
are  insufficient.  The  factor  plot  for  this  analysis  provides  no  additional  insight  into 
the  data  structure,  but  it  is  included  (Appendix  J)  for  completeness.  The  absence 
of  any  noticeable  clustering  of  factor  scores  further  illustrates  the  complexity  of  this 
particular  data  structure 

Conclusions.  Although  the  eigenvalue  residuals  were  predictable 
with  a  linear  regression  model,  these  functions  were  very  complicated  and  difficult 
to  interpret.  Perhaps  a  different  set  of  independent  variables  would  enable  us  to 
identify  a  simpler  underlying  structure.  Complexity  due  to  geometry  may  still  have 
some  influence  on  eigenvalue  residuals,  but  our  narrow  complexity  index  r£inge  does 
not  allow  us  to  assess  this  possibility. 

4.5  Summary 

At  the  onset  of  this  study  we  intended  to  investigate  three  issues  with  respect 
to  Kaiser’s  normcil  varimax  criterion: 

•  How  well  does  the  normal  varimax  perform  over  a  wide  range  of  sample  size, 
structure  complexity,  variable  communedity  and  factor  loading? 

•  In  addition  to  restoring  the  known  structure  of  an  experimental  factor  pattern, 
how  effective  is  normal  varimax  in  terms  of  returning  variable  loadings  and 
eigenvalues? 

•  With  what  types  of  data  will  normal  varimax  not  outperform  raw  varimax? 

•  Are  there  circumstances  where  neither  rotation  criterion  is  desirable? 

Some  of  our  measures  of  merit  assessed  these  performance  sureais  very  well  and 
others  were  not  so  successful.  In  particular,  pattern  matching  in  conjunction  with  our 
chosen  predictor  variables  best  described  the  response  of  pattern  recovery  and  how 
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it  is  influenced  by  different  aspects  of  factor  pattern  complexity.  Although  RMSR 
and  RMSER  were  very  predictable,  they  did  not  allow  us  to  identify  a  simple  un¬ 
derlying  relationship  with  respect  to  factor  pattern  loading  and  eigenvalue  recovery. 
We  propose  that  perhaps  these  are  not  key  performance  areas  and  factor  pattern 
structure  recovery  should  be  considered  of  primary  importance.  In  terms  of  factor 
pattern  recovery,  we  clearly  saw  that  the  raw  and  norm2d  varimax  criterion  were 
both  influenced  by  factor  pattern  uniqueness  and  stability.  At  no  time  did  we  see 
normal  varimax  outperform  raw  varimax  in  any  performance  area.  Furthermore  we 
saw  that  at  high  levels  of  factor  pattern  uniqueness,  neither  rotated  factor  pattern 
outperformed  the  unrotated  factor  pattern  in  factor  pattern  recovery.  With  more 
study  this  final  observation  may  provide  valuable  insight  to  the  researcher  conduct¬ 
ing  factor  analysis.  If  during  his  analysis  he  finds  no  difference  between  the  rotated 
and  unrotated  factor  patterns,  perhaps  the  researcher  can  conclude  that  he  already 
has  already  identified  the  simple  structure,  or  there  is  no  simple  underlying  struc¬ 
ture  present  in  his  data.  At  that  point  he  should  select  a  different  set  of  measured 
variables,  extract  a  factor  pattern,  and  rotate  to  determine  which  is  the  case. 
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V.  Recommendations 


5.1  Future  Research 

Future  studies  on  the  sensitivity  of  factor  analysis  techniques  should  certainly 
be  pursued.  The  source  code  produced  for  this  Monte  Carlo  study  is  well  suited 
to  work  beyond  the  scope  of  this  effort.  The  idea  of  geometric  complexity  may 
be  valid,  but  the  range  of  our  complexity  index  was  too  narrow  to  really  asses  the 
VeJidity  of  this  assumption.  Future  work  should  also  address  other  methods  for 
characterizing  factor  pattern  behavior.  Additional  performance  areas  must  also  be 
addressed  before  concluding  factor  pattern  recovery  is  sufficient  for  assessing  rotation 
criterion  accuracy.  Obviously,  future  efforts  should  also  be  expanded  to  include 
rotation  methods  other  than  varimax  criterion. 

We  focused  on  smaller  sample  sizes  to  explore  the  threshold  for  satisfactory 
factor  rotation.  As  measured  by  fcictor  pattern  recovery,  this  threshold  appears  to  be 
lower  than  expected.  Perhaps  RMSR  and  RMSER  are  heavily  influenced  by  sample 
size.  This  should  be  answered.  In  addition,  sample  size  should  be  investigated  for  its 
effect  on  rotation  reliability  where  reliability  is  determined  by  the  standard  deviation 
of  factor  pattern  scores. 

In  this  effort  we  made  a  dimensionality  assumption  by  retaining  four  factors. 
This  was  done  to  be  consistent  with  Ksuser’s  dimensionality  in  his  validation  of 
the  normal  varimax  criterion.  Different  variable-factor  ratios  may  have  a  signiflcamt 
impact  on  factor  rotation. 

Recall  that  when  calculating  the  pattern  matching  scores,  we  converted  each 
observed  factor  pattern  to  ones  and  zeros.  This  provided  a  simple  method  for  calcu¬ 
lating  matching  scores,  but  some  information  was  lost.  Two  adjacent  factor  loading 
may  be  very  close  in  value,  yet  one  will  ultimately  be  changed  to  a  zero  loading.  The 
zero  loading  may  have  been  the  true  significant  loading  in  the  experimental  factor 
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pattern  and  just  missed  being  matched.  These  types  of  occurrences  also  need  to  be 
considered. 

Finally,  the  Monte  Carlo  method  is  a  very  valuable  technique  that  should  be 
applied  to  resejirch  outside  the  field  of  factor  analysis.  Modern  personal  computers 
and  work  stations  make  this  approach  readily  accessible. 
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Appendix  A.  Data  Set  Generation 
A.l  FORTRAN  code 

This  Appendix  lists  the  FORTRAN  code  for  generating  the  sample  data.  It 
takes  a  covariance  matrix,  performs  a  Choleski  decomposition  and  generates  100 
data  sets  of  random  multivariate  normal  deviates  for  experimental  factor  pattern 
number  one  (in  this  case),  smallest  (N=17)  sample  size.  The  data  file  is  formatted 
as  a  1700*4  matrix. 


PROGRAM  RAIOOM 

IITEGER  I.  IRAHK.  ISEEO,  J,  K.  LOR,  LDRSIG.  lOUT,  MR.  I 
REAL  R(17,16),  RSIG(16.16) .RC0V(16, 16) 

EXTERIAL  CHFAC.  RIMVl,  RISET,  UMACH 

CALL  UMACH (2, MOOT) 

IR=17 
I  =16 
LDRSIG=16 
LDR=17 

*«*«=0PEI  THE  FILE  COITAIIIIG  THE  COVARIAICE  MATRIX  FOR  EZPERIMEITAL**** 
•♦•♦♦FACTOR  PATTERi  1,  CALCUUTED  FROM  THE  PRODUCT  OF  THE  LOADIHG^^^^^^^ 
♦♦♦♦♦MATRIX  AMO  ITS  TRAISPOSE.  DOIT  FORGET  TO  HAVE  ADDED  THE  DIAGOMAL^^ 
♦♦♦♦♦MATRIX  OF  THE  UIIQUEIESS  VALUES.  READ  COVARIAICE  MATRIX  AID  OPEI^^ 
♦♦♦♦♦FILE  THAT  HILL  HOLD  100  SAMPLE  SETS  OF  RAIDOM  MULTIVARIATE  lORMAL^^ 

^♦^♦*deviates^^^^^^***^*=*^**^*^*****=**=*****=*^**=*^*==*^^**=^^*^^^^^^ 
^♦♦♦«THE  LEADIIG  6^0  sub  matrix  OF  the  COVARIAICE  MATRIX  IS  SHOHI  BELOH^ 


♦ 


1 

.81 

.81 

.81 

0 

0 

* 

.81 

1 

.81 

.81 

0 

0 

.81 

.81 

1 

.81 

0 

0 

.81 

.81 

.81 

1  " 

0 

0 

* 

0 

0 

0 

0 

1 

.81 

0 

0 

0 

0 

.81 

1 

OPEI ( 3 , FILE= ' 8 tructar« . dat ' ) 

READ(3.J).  ((RC0V(I,J).J=1.K),I=1,K) 

CL0SE(3) 

OPEI(  1  ,FILE= » sampl*.  dat ' ) 

♦♦♦♦♦CREATE  DATA  SETS  IICREMEITIIG  THE  SEED  WITH  EACH 

ISEED  =  1234S7 
DO  20  1=1.100 

CALL  CHFAC  (X.  RCOV,  16,  0.00001.  IRAIK.  RSIG.  LDRSIG) 
CALL  RISET(ISEED) 

CALL  RIMVl  (IR.  K.  RSIG.  LDRSIG.  R.  LDR) 

♦♦♦♦♦WRITE  THE  100  DATA  SETS  TO  OUTPUT 

WRITE  (1.10)  ((R(I.J).J=1.X).I=1.IR) 

ISEED  =  ISEED-MOO 
20  COITIIUE 

10  FORMAT  (1X.16F8.4) 

CLOSE(l) 

EID 
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♦♦♦♦the  LEADIIG  6^6  SUB  MATRIX  OF  THE  16^1700  DATA  SET  IS  SHOWI  BELOW^^^ 


2.0516  1.5520  1.5405  2.0164  0.4144 

1.0833  1.1174-0.0433  1.7127  1.2355 
0.0826  0.6900  0.1764  1.3174  0.9498 

1.2777  0.5152  0.1561  0.2775  0.9056 

-1.2260  -0.7603  -0.6753  -0.6706  0.8173 

0.3385  0.4181  1.8470  1.1316  0.8911 


0.1419 

1.9269 

1.0576 

1.0729 

0.6975 

1.3856 


4^ 


Appendix  B.  Index  Routine 


B.l  FORTRAN  code 


This  Appendix  lists  the  FORTRAN  code  for  creating  an  index  vector  for  sub¬ 
grouping  the  sample  data  file  into  100  data  sets  having  the  appropriate  number  of 
observations. 


PROGRAM  IHOEX 

IITEGER  K.  IR.  V,  I.  L.  E(16,l) 

MR  »16 

K  =17 

T  =K*lfR 

OPEI ( 18 . FILE=  *  index . dat ' , F0RM=  *  FORMATTED ' ) 
1=0 

D0200L=1,100 
DO  100  1=1,17 
E(K.1)=I+1 
WRITE  (18,10)  E(K,1) 

100  COITIIUE 

1=1+1 

200  COITIIUE 

10  FORMAT  (13) 

CL0SE(18) 

EID 
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Appendix  C.  Unrotaied  Factor  Pattern  Generation 

C.  1  SAS  code 

This  Appendix  lists  the  SAS  code  for  gererating  the  observed  unrotated  factor 
pattern  for  each  of  the  100  sampled  data  sets.  The  data  file  produced  by  the  data 
generation  code  is  merged  with  an  index  vector  so  we  can  factor  analyze  100  sub¬ 
groups  corresponding  to  the  appropriate  sample  size.  For  example,  the  data  file  for 
the  small  sample  size  will  be  a  1700*16  matrix.  The  index  vector  will  range  from 
1  to  100  with  17  iterations  of  each  number.  SAS  will  factor  analyze  the  first  17 
observations,  second  17  observations  and  so  forth,  until  it  has  factor  analyzed  100 
sets  of  17  observations. 


options  linssizssTS; 

FILEKAMEIEW  ' sample. dat>; 

DATA  XXI; 

IMFILE  lEV* 

input  XI  X2  X3  X4  X5  X«  X7  X8  X9  XIO  Xll  X12  X13  X14  XIS  X16: 
DATA  XX2: 

IIFILE  Undex.dat*; 
input  index; 

DATA  XX3; 
merge  XX2  XXI; 

eroc  factor  data=XX3  method^prin  nfactors=4; 
y  index; 


-  IIDEX=1 


Initial  Factor  Method:  Principal  Components 

Prior  Commonality  Estimates:  DIE 
BigenTalues  of  the  Correlation  Matrix:  Total  =  16  Average  -  1 


12  3  4 


Eigenvalue 

Difference 

Proportion 

Cumulative 

6.2966 

3.1842 

0.3936 

0.3936 

3.1123 

0.2434 

0.1946 

0.6881 

2.8689 

0.9304 

0. 1793 
0.7674 

1.9386 

1.4314 

0.1212 

0.8885 

Eigenvalue 

Difference 

Proportion 

Cumulative 

6 

0.6071 

0.0944 

0.0317 

0.9202 

6 

0.4127 

0.1429 

0.0268 

0.9460 

7  - 

0.2698 
0.0369 
0.0169 
0.9629 

8 

0.2339 

0.1126 

0.0146 

0.9776 

Eigenvalue 

Difference 

Proportion 

Cumulative 

9 

0.1213 

0.0206 

0.0076 

0.9861 

10 

0.1008 

0.0448 

0.0063 

0.9914 

11 

0.0660 

0.0096 

0.0035 

0.9949 

12 

0.0466 

0.0279 

0.0029 

0.9978 

13 

14 

16 

16 
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/  . 

*■  > 

/ 

/ 

Eigenvalue 

0.0187 

0.0143 

0.0027 

0.0001 

Difference 

0.0044 

0.0115 

0.0027 

Proportion 

0.0012 

0.0009 

0.0002 

0.0000 

Cunulative 

0.9989 

0.9998 

1 . 0000 

1.0000 

4  factors  sill  be  retained  by  the  IFACTOR  criteri  . 
Factor  Pattern 


FACTORl 

FACT0R2 

FACT0R3 

FACT0R4 

XI 

-0.63209 

0.73981 

0.14878 

0.09028 

X2 

-0.60765 

0.74434 

0.02464 

0.30341 

X3 

-0.66022 

0.73031 

0.16927 

-0.07489 

X4 

-0.32998 

0.82213 

0.28371 

0.11622 

xs 

0.63843 

0.20186 

0.39150 

-0.49487 

X6 

0.64913 

0.48773 

0.23666 

-0.47719 

X7 

0.48365 

-0.12627 

0.66814 

-0.46377 

X8 

0.64716 

0.26690 

0.36936 

-0.39919 

X9 

-0.48783 

-0.17746 

0.73005 

0.12092 

XIO 

-0.69967 

-0.34110 

0.66967 

0.11973 

Xll 

-0.64469 

-0.30897 

0.58889 

-0.02810 

X12 

-0.70671 

-0.33167 

0.66528 

0.07712 

X13 

0.70811 

0.27420 

0.14132 

0.61245 

X14 

0.76861 

-0.00661 

0.31612 

0.61030 

X16 

0.82272 

-0.07691 

0.30864 

0.43768 

X16 

0.76217 

0.04723 

0.32964 

0.47136 
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Appendix  D.  Monte  Carlo  Routine 
D.l  FORTRAN  code 

This  Appendix  lists  the  FORTRAN  code  for  the  Monte  Carlo  method  used 
in  this  research.  The  program  reads  the  experimental  factor  patterns  and  the  SAS 
generated  unrotated  factor  patterns.  It  utilizes  a  loop  to  read  100  observed  unrotated 
factor  patterns  that  have  been  stored  in  one  file  by  reading  the  first  1-16*4  factor 
loadings,  the  second  17-32*4  factor  loadings  ect.  It  then  calculates  all  predictor 
values,  performs  the  raw  and  normal  varimax  rotations  and  calculates  all  measures 
of  merit.  The  measures  of  merit  are  taken  at  the  grand  mean  of  the  100  observed 
foactor  patterns  of  each  type  (unrotated,  raw  and  normal)  produced  from  every 
experimental  factor  pattern. 


IITEGER  LDA,  LOB.  LOT,  MAXIT.  IF.  lORM,  IVAR,  X, 

*  F.  ROU,  COL,  SAMPLE,  S,  STR,  Z. 

I  SUNI,  SUMP,  SUNIR,  SUMPR,  SUHIK,  SUMPK, 

*  BUI,  HRV,  HKI,  COURT 


REAL  EPS.  V.  SR.  ESR.PESR.AMESR, 

*  SESR,  RSESR,  XSESR,  AIRHITS,  ABRBITS, 

ft  SSR,  RSSR,  KSSR,  AIIHITS,  AIBBITS, 

ft  ANSR,  AIKBITS,  ABKBITS,  RANESR,  RANSR, 

ft  KANSF,  TOTSIROV,  STRAT,  BIIDEI,  PANESR, 

ft  CIIDEX,  TBIIOEX,  PANESR.  PKANESR.  PRAMESR, 

ft  PSESR,  PRSESR.PAMSR.PESR. 

ft  PESR,  USSE,  SOUH,  USSN,  SDUN,  RSSE,  SORE, 

ft  RSSM,  SORN,  XSSE,  SOKE,  KSSM,  SDKN  .UUSSE, 

ft  __  SDUE,  SDUUE.PUSSM.PSDUM.ORSSE.OSDRE.PRAMSR, 
ft  PRSSN.PSDRH.XANESR.UKSSE.USOXE.PKSSN.PSDXN 


PARAMETER  (EPS=0.0,  LDA=16,  LDB=16.  L0T=4.  NAXIT=30, 
ft  IF-4,  I0RM=K,  IVAR=10.  H=1.0.  LDD-160, 

ft  SAMPLE=100) 


A(LDA,IF),  B(LDB,IF),  T(LDT,IF), 

LOAD (IVAR. IF),  C(16,4), 

PRIUN(i6.4,SANPLE).  PIIUM(1 ,4, SAMPLE) , 

RIUM(16, 4, SAMPLE),  Uliq(16).  PXIUM (1,4, SAMPLE ) . 
T0TBU6).IIUM(1, 4, SAMPLE),  XIUN (1.4, SAMPLE) .  IIUN(4). 
R( 16 ,4. SAMPLE),  R(16,4),ER(1,4.SAMPLE), 
PERN(16,4.24).  PER (1.4, SAMPLE  ),  PRER(1,4,SANPLE) . 
PNESR(SANPLE) .  NSR(SANPLE),  PKNESR(SAHPLE} , 
XNSR(SANPLE) ,  PRMESR(SANPLE) .  RNSR(SAMPLE) . 
NESR(SANPLE) .  PER(1 .4, SAMPLE) .PNSR(SAMPLE) . 

RER(  1,4, SAMPLE),  RMESR(SAMPLE) ,  PRME5R(.SANPLE) , 
PRNSR(SAMPLE) .XHESR( SAMPLE) ,PKNSR(SANPLE) . 
CB(16,1).CK(16.4) 


IITEGER  D(ie,4).  TRL0AD(4, 16) .  PRL0AD(4,4.24) . 
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»  IUMHITS(24,SAHPLE).U(16.4,24),  RV(16,4.24), 

ft  KV(16,4.24) 

EXTERIAL  FROTA.  VRRRlf 


FsO 


♦•♦♦♦♦CREATE  THE  DATA  FILE  ALL  STATISTICAL  OUTPUT****************** 

OPEI(  UHIT=26.  FILE=*out.dat') 

♦♦♦♦♦♦OPEI  aid  READ  THE  DATA  FILE  COITAIIIIG  THE  EXPERIMEITAL****** 
******L0ADII6S  MATRIX**********************************  >**v******** 

OPEI(l.FILE='in.dat') 

READCl,*),  ((LOAD(I,J),J=l,IF),I=l.IVAR) 

CLOSE(l) 

♦♦♦♦♦♦calculate  the  STURCTURE  IIDEX  for  the  EXPERIMEITAL  LOADIIGS** 
♦♦♦♦♦♦matrix**********************************^******************** 

CIMDEX=0.0 
T0T3IR0W=0.0 
DO  822  1=1,16 

TOTSIROW=TOTSIROl/+((LOAD(I.l)*LOAC(I,2))**2+(LOAD(I,l)*LOAD(I,3))**2 
ft  ♦(LOAD<I . i5*LOAD<I ,4) ) **2+(L0AD(I ,2)*L0AD(1 ,3) )**2 
ft  +  (LOAD  (1 , 2)  *LOAD  (1,43)  **2+  (LOAD  (1,33  ♦LOADU  ,433**2) 

822  COITIIUE 

CIIDEX=T0TSIR0H/16 . 0 

♦♦♦♦♦♦calculate  the  UIIQUEIESS  IIDEX  FOR  THE  EXPERIMEITAL  LOADIICS** 

♦♦♦♦♦♦matrix********************************************************* 

THIIDEX=0.0 
DO  932  1=1,16 

uiiq(ij=o.o 
TOTH(I3*0.0 
932  COITIIUE 

DO  842  1=1,16 
DO  832  J=l,4 

T0TH(I)=T0TH(I)+(L0AD<T,J)**2) 

832  COITIIUE 

UIiq(I)=l-TOTH(I) 

THIIDEX=THIIOEX*UIiq (I ) 

842  COITIIUE 

HIIDEX=TBIIDEX/16.0 

♦♦♦♦♦♦COIDUCT  BIIARY  TRAISFORMATIOI  OF  EXPERIMEITAL  LOADIIGS  MATRIX*** 

DO  1021  I=1,IVAR 
DO  1020  J=1.IF 
D(I,J)=0 

1020  COITIIUE 

1021  COITIIUE 

DO  1032  I=1,IVAR 
BIG=ABS(LOAO(I.l)} 

L0CBIG=1 
D(I,1)=1 
DO  1031  J=2,IF 

IF  (ABS(L0A0(I,J})  .GT.  BIG)  THEI 
D(I.J)=1  ^ 

D(I,LOCBIG)=0 

BIG=ABS(LOAD(I,J)) 

LOCBIG=J 
EID  IF 

1031  COITIIUE 

1032  COITIIUE 

♦♦♦♦♦•IF  desired,  LOADIIGS  MATRIX  OF  I'S  AID  O'S  CAI  BE  HRITTEI  OUT*** 

*  PRIIT*, 'SIMPLE  STRUCTURE  PATTERI' 
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•  PRUT* 

•  WRITE(*,14)((D(I,J),J=1.IFJ.I=1.16) 

•  PRIIT* 

•  WRITE(26,*)*  • 

•  WRITE (26. 7000) 

*7000  F0RMAT(21X, 'IIITIAL  FACTOR  PATTERI') 

•  HRITE(26,*)*  * 


* 

•7001 


¥RITE(26,7001)  ((D(I.J),J«1,IF),I»1,16) 
F0RMAT(22X,4I4) 


•«****CALCULATE  THE  TRAHSPOSE  OF  TEE  IIITZAL  STRUCTURE  SO  PATTER!***** 
«*****HATCHI!6  score  CAI  BE  CALCULATED******************************** 


C0L»1 

DO  1132  I-I.IF 
R0W=1 

DO  1131  J=1.HVAR 

TRLOAD  ( I ,  J  )  =D  (ROW .  COL) 
R0V=R0H*1 
1131  COmiUE 


C0L=C0L+1 
1132  COITIXUE 


CALCULATE  EIGEIVALUES  OF  lilTIAL  LOADIIG  STRUCTURE************** 


DO  900  J-l.HF 
IIUM(J)*0.0 
DO  800  Isl.lVAR 

IIUN(J)«IiUH(J)*LOAO(I.J)**2 
800  COITIIUE 
900  COITIIUE 

***«***CALCULATE  STABILITY  RATIO************************************* 


STRAT»0.0 

STRAT=STRAT*ABS(IIUN(1 )/IIUM(4) ) 


'AT  THIS  POUT,  ALL  THE  EXPERINEITAL  FACTOR  PATTERI  HAS  BEEI***** 
AID  ALL  PREDICTOR  VARIABLES  HAVE  BEEI  CALCULATED**************** 


******IIITIATE  LOOP**************************************************** 

******HERE  UE  IIITZATE  THE  LOOP  FOR  READIIG  II  100  SAMPLE  UIROTATED**** 
******FACTOR  PATTERIS  GEIERATED  II  SAS,  CALCULATE  OUR  MEASURES********* 
******MERIT,  AID  STATISTICS******************************************** 
******VE  MUST  ALSO  IIITIALIZE  ALL  OF  OUR  STATISTICS******************** 

SUMP*0 

SUMI-0 

SUNPR-O 

SUMIR=0 

SUMPK^O 

SUNIX>0 

HUI-0 

HRV>0 

HKIsO 

SESR>0.0 

SSR=0.0 

RSESR^O.O 

RSSR=0.0 

KSESRsO.O 

XSSR=0.0 

PSESR=0.0 

PRSESR=0.0 

PXSESR=0.0 


OPEI  FILE  AID  READ  THE  100  UIROTATED  SAMPLE  FACTOR  PATTERIS 


♦♦♦♦♦♦GEHERATED  from  each  of  our  Z=36  experimeital  factor  patterns**** 


0PE«(2,FILE=INITIAL(2)) 

DO  300  8=1,100 

READ(2,*),  ((A(I.J),J=1.>F).I=1,«VAR) 

♦♦♦***(A(I,J)  IS  OUR  SAMPLE  UIROTATED  FjiCTOR  PATTERI^****************# 

♦♦♦♦♦♦GEHERATE  permutatiois  of  our  sample  umrotated  factor  patteri**** 
*•♦♦♦*1*  PREPARATIOH  FOR  DETERMIIIIG  BEST  PATTER  MATCHIIC  SCORE******* 

DO  2001  I=1,IVAR 
DO  2000  J=1.IF 
PERM(I,J,1)=A(I,J) 

2000  COITIIUE 

2001  COITIIUE 

DO  2002  1=1,16 
PERM(I,1,2)=A(I,1) 

PERM(I.2,2)=A(I,2) 

PERM(I,3,2)=Aa,4) 

PERM(I.4,2)=A(I,3) 

2002  COITIIUE 

DO  2003  1=1,16 
PERM(I.1,3)=A(I,1) 

PERM(I,2,3)=Aa,3) 

PERMCI,3,3)=A(I,2) 

PERM(I,4,3)=Aa,4) 

2003  COITIIUE 


■\  ^ 


2004  COITIIUE 


l.K 

II 

;i.i; 

II 

1.3 

)=A 

1.4 

)«A( 

*1.2) 

■■■i. 


2wor 


DO  2006  1=] 

1.16 

PERN 

1.1.6. 

II 

PERNi 

1.2,6 

It 

PERMi 

1.3.6! 

11 

> 

PERM( 

1.4.6! 

11 

2005  COITIIUE 


DO  2006  1=1, le 

PERNi 

I,1,6)=A 

[i.i; 

PERMi 

I,2.6)=A 

1.4 

PERNI 

I.3,6)=A 

1.3 

PEPJli 

I.4.6)=AI 

1.2) 

2006  COITIIUE 


DO  2007  1=1,16 

PERM(I,l,7j=ArT,2) 

PERM?I.2,-r<-^A(I,l) 

PBR1I(T,3,7)=A(I,3) 

?£kH(I,4,7)=A(I,4) 

COITIIUE 


DO  2008  1=1,16 
PER1((I,1.8}=A(I,2) 
PERHa,2,8)=A(I,l) 
PERMCI,3,8)=A(I,4) 
PERM(I,4,8)=A(1.3) 
2008  COITIIUE 


PERM(I,2,0 


1.1« 

)=Ai 

1.2; 

)=AI 

1.3 

II 

1.1 

II 

1.4) 

D-4 


'■  ' ' 

V  ' 

v . 

J  -N  ' 

.  ".  V 

i  / 


r  . 


,  * 


/ 

/ 


2009  COITIIUE 


DO  2010  1=1, 

,16 

PERM! 

1,1,10 

l=AI 

1,2) 

PERN( 

1.2,10 

II 

PERM 

1.3,10 

II 

> 

1.45 

PERN( 

!i,4,ioj 

11 

I.l) 

2010  COITIIUE 


DO  2011  1=1, 

16 

PERN( 

1.1.11 

l=AI 

1.2) 

PERN( 

1.2,11 

II 

1.4) 

PERN( 

1.3,11 

II 

I.lJ 

PERN( 

!l,4,llj 

»*A( 

1.3) 

2011  COITIIUE 


DO  2012  1=1, 

,16 

PERM( 

1.1.12 

l=AI 

1,2) 

PERN( 

1.2.12 

II 

PERH( 

1.3.12 

It 

1.3) 

PERN( 

:i.4.i2: 

11 

:i.i) 

2012  COITIIUE 


DO  2013  1=1.16 

PERMa.l.l3]=A(I.3^ 

PERM(I,2,13)=ACI.l) 

PERM(I,3,13)=A(I.2] 

PERN(I.4,13)=A(I.4) 

2013  COITIIUE 

DO  2014  1=1,16 

PERM(I.1,14)=A(I,3) 

PERN(I.2.14)=Aa.l) 

PERM(I,3.14)=A(I.4) 

PERN(I.4.14}=A(I.2) 

2014  COITIIUE 


DO  2016  1=1, 

PERM( 

1.1.15 

i=AI 

1.3) 

PERN 

1.2.16 

i=AI 

1.2) 

PERM 

1.3,16 

II 

1.1) 

PERN( 

,1.4,16} 

fl 

1.4) 

2016  COITIIUE 


DO  2016  1=1, 

16 

PERNi 

1.1.16 

=A 

1.3 

PERNi 

1.2.16 

=A 

1.2 

PERNI 

1.3,16 

*A 

1.* 

PERN( 

1.4.16} 

«A( 

1,1) 

2016  COITIIUE 


DO  2017  1=1, 

16 

PERMi 

1.1,17 

=A 

1.3 

PERMi 

1.2,17 

bA 

1.* 

PERNI 

1.3.17 

=Ai 

1.1 

PERN( 

1.4.17} 

=A( 

1.2) 

2017  COITIIUE 


DO  2018  1*1, 

16 

PERNI 

1.1.18, 

*A 

[1.3} 

PERNI 

1,2,18, 

It 

1.4 

PERNI 

1.3.18, 

II 

1.2 

PERN( 

1.4.18} 

II 

1.1) 

2018  COITIIUE 


DO  2019  1*1,16 
PEIU((I.1.19)=A(I,4) 
PERX(I,2.19)=A(I.i5 
PBUI(I.3,19)=A(I.2) 


r 


V 


PEW!(I,4,19)=A(I,3) 
2019  COmiUE 


DO  2020  1=1, 

,16 

PERM( 

1.1.20 

l=A( 

I.l) 

PERM( 

1.2,20 

l=A( 

I.l) 

PERN! 

1.3,20 

l=A( 

1.3 

PERM( 

1.4,20 

l=A( 

1.2 

COITIIUE 

DO  2021  1-1,16 
PEIU((I,1.21}=ia.4) 
PERM(I,2.21)=1(I.2) 
PERN(I,3,21]=A(I.l) 
PERM(I.4,21)=A(I.3) 
2021  COITINUE 


DO  2022  1=1,16 
PERMh,l,22J=A(I.4) 
PEM((I,2,22)=A(I.2) 
PERN(I,3,22)=A(I,3} 
PERM{I.4.22)=A(I.l) 
2022  COITIIUE 


DO  2023  1=1,16 
PEWCh,  1,235=1(1,4) 
PERH(I,2,23)=A(I,3) 
PEWI(I,3,23)=A(I,1) 
PERN(I,4,23)=A(I,2) 
2023  COITIIUE 


DO  2024  1=1,16 
PEM((1, 1,245=1(1,4) 
PERN(I,2,24)=A(I,3) 
PE]U((I,3,24)=A(I,2) 
PEIU((I,4,24)=Aa,l) 
2024  COITIIUE 


****4.*PUT  ALL  PERHUTTED  MATRICES  IITO  BIIARY  FORM  II  PREPARATIOI  T0***= 
•***4.*P0ST  MULTIPLY  THE  TRAISPOSE  OF  THE  EXPERIMEITAL  FACTOR  PATTERI*** 
******T0  DETERNIIE  BEST  FACTOR  PATTERI  SCOKE*************************** 

DO  1093  H=1.24 

DO  1081  I=1,IVAR 

DO  1080  J=1.IF  1 

0(I,J,H)=0 

1080  COITIIUE 

1081  COITIIUE 


DO  1092  Z=1,IVAR 

BIG=ABS(PERN(1.1,H)) 

L0CBIC=1 

0(I,1.H)=1  1 

DO  1091  J=2,IF  \ 

IF  (ABS(PERM(I,J.H))  .6T.  BIS)  THEI 
0?I.J,H)=1  ^ 

0(I,L0CBIG,H)=0  1 

BIG=ABS(PERM(I,J.H)) 

L0CBI0=J  I 

EID  IF  I 

1091  COITIIUE 

1092  COITIIUE 

1093  COITIIUE 


=«****CALCULATE  PATTERI  MATCHIIG  SCORE  FOR  EACH  PERNUTATIOI  OF  SAMPLE*** 
******UBSERVED  UIROTATEO  FACTOR  PATTERI********************************* 


DO  3000  H=1.24 
DO  1142  1=1.4 
PRLOAD(I,1.H)=0 
DO  1141  J=1,IVAR 

PRL0aD(I.1,H)=PRL0AD(I,1.H)+(TIILQAD(I,J)*U(J,1,H)) 

1141  COmiUE 

1142  COmXUE 

DO  1144  1=1,4 
PRL0AD(I,2,H)=0 
DO  1143  J=1,IVAR 

PRL0AD(I,2.H)=PRL0AD(I.2,H)4^(TRL0AD(I,J)«U(J,2.H}) 

1143  COITIIUE 

1144  COITIIUE 

DO  1146  1=1,4 
PRL0AD(I,3.H)=0 
DO  1145  J=1.IVAR 

PRL0AD(I,3,H)=PRL0AD(I,3,H)+(TRL0AD(I,J)*U(J,3,H)) 

1145  COITIIUE 

1146  COITIIUE 

DO  1148  1=1,4 
PRLOAO(I,4.H}=0 
DO  1147  J=1.IVAR 

PRL0AD(I.4.H)=PRL0AD(I.4.H)-t-(TRL0AD(l,J)«U(J.4.H)) 

1147  COITIIUE 

1148  COITIIUE 

IUNHITS(H,S)=0 
DO  1149  1=1,4 

IUNHITS(H,S}=IUMHITS(H,S)+PRLOAD(I,I,H) 

1140  COITIIUE 

3000  COITirUE 


*«**«4>DETERMIIE  best  pernutatioi  by  determiiiig  highest  SC0RIIG****« 
(lUNHITS)  OF  ALL  PERHUTATIOIS**********'!'*********'***********'*** 

HUI=IUMHITS(1.S} 

1D=0 

DO  3500  H=2.24 

IF  (IUNHITS(H.S)  .GT.  HUI)  THEI 
HUI=IUI(HITS(H,S) 

IO=B 
BID  IF 
3600  COITIIUE 

WE  ARE  lOV  VORKIIG  HITI  THE  LAST  OF  OUR  SAMPLE********* 
*******UIROTATED  FACTOR  PATTERIS,  CALCULATE  THE  AVERAGE********** 
*«***«*IU)(BER  OF  HATCHES  FOR  THE  SAMPLE************************** 

SUMP=SUMP+EUI 

IF  (S  .EQ.  SAMPLE)  THEI 

AIBHITS=FLOAT(SUMP) /FLOAT (SAMPLE) 

EID  IF 

******CALCUUTE  EIGEIVALUES  BEST  PERMUTTED  FAaOR  PATTERI******** 

DO  276  J=l,4 

PRIUM(1,J,S)=0.0 
DO  260  1=1,16 

PRIUM(1.J,S)  =PhIUM(l,J,S)+PERM(I,J,ID)**2 
260  COITIIUE 
276  COITIIUE 


******CALCULATE  THE  EIGEITALUE  RKSR  FOR  EACH  BEST  PERMUTED  SAMPLE** 
******  UIROTATED  SAMPLE  FACTOR  PATTERI***************************** 

DO  421  J=l,4 
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PER(l,J,S)=(PRHUM(l,J,S)-IltUM(J))**2 
421  COBTIKUE 

PESR=0.0 

DO  42T  J=l,4 
PESB=PESR+PER(1.J,S) 

427  COHTIIUE 

PIfESR(S)=SqRT(PESR/4.0) 

*«*4.**CJLCULATE  the  loadimg  rmsr  for  each  best  permuted  sample***** 
******  UHROTATED  SAMPLE  FACTOR  PATTERM******* ********************** 

DO  134  1=1,16 
DO  133  J=1.4 

R(I , J)=(LOAD(I . J)-PERM(I , J , ID) ) **2 

133  CONTIMUE 

134  COMTIIUE 

SR=0.0 

DO  136  1=1,16 
DO  13S  J=l,4 
SR=SR+R(I,J) 

135  COHTIIUE 

136  COHTIIUE 

PMSR(S)=SPRT(SR/(16*4)) 

WE  ARE  HOW  WORKIIG  WITH  THE  LAST  OF  OUR  SAMPLE******'*** 
*******UKR0TATED  factor  PATTERHS,  CALCULATE  THE  AVERAGE********** 
«4i«****EXGKIVALUE  RMSR  FOR  THE  SAMPLE**************************** 

PAMESR=0.0 
DO  222  J=l, SAMPLE 

PAMESR=PAHF^R-«-PMESR  (  J  ) 

222  COHTIIUE 

PAMBSR=PAMESR/SAMPLE 

****«*CALCULATE  THE  STAHDARD  DEVIATIOH  OF  THE  EIGEHVALUE********* 
•*****RNSR  FOR  THE  SAMPLE  OF  OBSERVED  UHROTATED  PATTERHS********* 

USSE=0.0 

DO  335  J«l, SAMPLE 

USSE=USSE+(PMESR(J)-FAMESR)**2 
335  COHTIIUE 

SDUE=SqRT(USSE/(SAMPLE-l} ) 

*******1P  VE  ARE  HOW  WORKIHG  WITH  THE  UST  OF  OUR  SAMPLE********* 
♦♦♦♦♦♦♦UIROTATED  FACTOR  PATTERHS,  CALCULATE  THE  AVERAGE********** 
*«*«*«*L0ADIIGS  rmsr  for  THE  SAMPLE****************************** 

PANSR=0.0 
DO  055  J=l, SAMPLE 
PAMSR=PAMSR*PNSR ( J ) 

955  COHTIIUE 

PAMSR=PAMSR/SANPLE 

*****CALCULATE  THE  STAHDARD  DEVIATIOH  OF  THE  LOADIHGS*********** 
*****RMSR  FOR  THE  SAMPLE  OF  OBSERVED  UHROTATED  PATTERHS********* 

PUSSM=0.0 

DO  953  J=l, SAMPLE 

PUSSM=PUSSH+(PMSR(J)-PAMSR)**2 
953  COHTIIUE 

PSDUM=SqRT(PUSSM/SAMPLE) 

ElO  IF 

*«****SET  K  TO  0  TO  PERFORM  RAW  VARIMAZ  ROTATIOI  OH  EACH  OF  THE**** 
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•♦♦♦♦♦observed  sample  uirotated  factor  patteris*******************^ 


K=0 

CALL  FROTA  (IVAR,  VF.  A.  LDA.  lORN,  NAZIT.  V,  EPS,  B.  LDB,  T, 
ALDT) 

♦♦♦♦♦♦CALCULATE  EIGEIVALUES  RAW  VARIMAX  ROTATED  FACTOR  PATTERI^^^^^^ 
♦♦♦♦♦♦the  MUST  BE  DOIE  TO  CALCULATE  MEASURES  OF  MERIT  AID  TO  EISURE^ 
♦♦♦♦♦♦the  ROTATED  FACTOR  PATTERI  IS  II  THE  CORRECT  COLUMI  ORDER^^^^^ 
♦♦♦♦♦♦SEE  CHAPTER  III  FOR  DETAILS 

DO  282  Jsl.4 

IIUM(1.J,S}»0.0 
DO  267  1=1 .16 

IIUM(1,J,S)=IIDM(1,J.S)+B(I,J)^^2 
267  COITIIUE 
282  COITIIUE 

♦♦♦♦♦♦SORT  EACH  COLUMI  OF  THE  EIGEIVALUES  OF  THE  ROTATED  PATTERI^^^^ 
♦♦♦♦♦♦PUT  FACTOR  PATTERI  COLUMI  II  CORRESPOIDIIG  OBDER^^^^^^^^^^=^^^ 

BIG=0.0 

DO  1121  J=1.IF 

IF  (IIUM(l.J.S)  .GT.  BIG)  THEI 
BIG=IIUM(1.J.S) 

AA=J 

EID  IF 

1121  COITIIUE 

IIUN(1.AA.S)=0.0 

BIG=0.0 

DO  1123  J=1,IF 

IF  (IIUN(l.J.S)  .GT.  BIG)  THBI 
BIG=IIUM(1.J,S} 

BB=J 
EID  IF 

1123  COITIIUE 

IIUN(1,BB,S)=0.0 

BIG=0.6 

DO  1125  J=1,IF 

IF  (IIUN(1,J.S)  .GT.  BIG)  THEI 
BIG=IIUN(1,J.S) 

CC=J 
EID  IF 

125  COITIIUE 

IIUM(1,CC,S)»0.0 
BIG-0. 0 

DO  1127  J-I.IF 

IF  (IIUMd.J.S)  .GT.  BIG)  THEI 
BIG-nUNd.J.S) 

DD»J 
EID  IF 

1127  COITIIUE 
IIUNd.DD.S)  =0.0 

♦♦♦♦♦♦♦REDEFIIE  ROTATED  FACTOR  PATTERI  II  CORRECT  FORN^^^^^^^^^^ 

DO  1128  1=1. IVAR 
CE(I.1)=B<I,AA) 

CBCI.2)=B(I.BB) 

CBCI,3)=B(I,CC) 

CBa.4)=B(l,0D) 

1128  COITIIUE 


♦♦♦♦♦♦HRiTE  CORRECTED  RAH  VARIMAX  FACTOR  PATTERI=^=^^^====^^=^^=== 
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PERM(I,3,10)=CB(I,4) 

PERM(l,4.10)=CBa.l) 

2220  COITIIUE 

DO  2221  1=1,16 
PERIIfI,l,llJ=CBfI,2) 
PERlf?l,2.in=CBh  4) 
PEIUI(I,3.11)=CB(I,1) 
PEI«(I.4,ll)=CBa.3) 

2221  COITIIUE 

DO  2222  1=1,16 
PERM(I.1,12)=CB(I,2) 
PElU!(I,2,12)=CBa,4) 
PEIUta,3,12S=CB(l  3) 
PERM(I,4,12)=CB(I,1) 

2222  COITIIUE 

DO  2223  1=1,16 

PERII(I,1,13)=CB(I,3) 

PE!lM(I,2.13)=CBa,l) 

PEltffI,3,13)=CB(I,2) 

PERI((I,4,13)=CB(I,4) 

2223  COITIIUE 

DO  2224  1=1,16 
PER1!CI.1,145=CB(I,»,) 
PERMfI,2.14)=CB(l,l) 
PERMtI,3,14)=CB(I,4) 
PERMa,4,14)=CB(I  2) 

2224  COITIIUE 

DO  2226  1=1,16 
PER1!(I,1,1SJ=CB(I,3) 
PEWI(I,2,16)«CBa  2) 
PE!lMa,3,16)«CB(l,l) 
PERM(I,4.1S)=CB(li4) 

2225  COITIIUE 

DO  2226  1=1,16 

PERI((I,1,16)=CB(I,3) 

PERMa,2,16)=CB(I,2) 

PERM(I,3,16}=CB(I,4) 

PERIl(l,4.16)=CB(I,l) 

2226  COITim 

DO  2227  1=1,16 

PERM(I,1,17}=CBCI,3) 

PEJWfI,2,17)=CBa,4) 

PEI«{I,3.17)=CB(I,1) 

PEI11I(I.4.17)=CB(I,2) 

2227  COITIIUE 

DO  2228  1=1,16 

PERN(I,1,18]=CB(I,3) 

PERN(I,2,18}=CB(I.4) 

PEIll!fI,3,18)=CB(I,2) 

PEIll!(I,4,18)=CB(I,l) 

2228  COITIIUE 

DO  2229  1=1,16 

PElUIfI,l,19j=CB(l,4) 

PEWICI,2,19)=CB(I,1) 

PERMCI,3,19)«CB(I,2) 

PERH(I.4,19)=CB(I,3) 

2229  COITIIUE 

DO  2230  1=1,16 

PERM(I,1,205=CB(I,4) 

PERMa,2.20)=CB(I,l) 

PE!U!CI,3,20)=CB(I,3) 

PEW!(I,4,20)=CB(I,2) 

2230  COITIIUE 
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DO  2231  1=1, 

>16 

PERK 

1.1.21 

l=CB( 

[1. 4) 

PERN 

1.2.21 

l=CB( 

1.2) 

PERM 

1.3.21 

l=CB( 

I.l) 

PERN( 

:i.4.2ii 

l=CB( 

1.3) 

2231  coin  VUE 

DO  2232  1=1,16 

PERM(I,1.22)=CBfI.4) 

PERM(I,2,22)=CB{I,2) 

PERM{I,3.22)=CBCI,3) 

PERM(I,4,22)=CB(I,1) 

2232  COITIIUE 


DO  2233  1=1, 

16 

PERM( 

1.1.23 

=CB( 

1.4) 

PERM 

1.2,23 

=CBI 

1.3) 

PERM 

,1.3,23 

=CB( 

I.lJ 

PERM( 

:i.4.23! 

=CB( 

1.2) 

2233  COITIIUE 


DO  2234  1=1, 

>16 

PERM( 

1.1.24 

l=CB( 

1.4) 

PERN( 

1.2.24 

l=CB( 

PERM 

1.3.24 

l=CB( 

1.2) 

PERN( 

1.4,243 

l=CB( 

I.l) 

2234  COITIIUE 

«***4.*PUT  all  PERMUTTED  matrices  IITO  BIIART  form  II  PREPARATIOI  TO**** 
******P0ST  MULTIPLY  THE  TRAISPOSE  OF  THE  EXPERIMEITAL  FACTOR  PATTERI*** 
«««4.**T0  DETERMIHE  BEST  FACTOR  PATTERI  SCORE  OF  EACH  OBSERVE  RAW******* 
«««*«*VARIMAZ  ROTATED  FACTOR  PATTERI*********************************** 

DO  1063  H=1.24 
DO  1041  I=1.IVAR 
DO  1040  J=1,IF 
RV(I,J,H)=0 

1040  COITIIUE 

1041  COITIIUE 

DO  1062  T=1,IVAR 

BIG=ABS(PERN(I.1,H)} 

L0CBIG=1 

RV(I.1,H)=1 

DO  1061  J=2,IF 

IF  (ABS(PERM(I.J,H})  .GT.  BIG)  THEI 

_ RVn.J.H)=l  ^  . . 

RV(I,L0CBIG,H)=0 

BIG=ABS(FERH(I.J.H)} 

L0CBIG=J 
EID  IF 

1061  COITIIUE 

1062  COITIIUE 
1053  COITIIUE 

******CALCUUTE  PATTERI  MATCHIIG  SCORE  FOR  EACH  PERMUTATIOI  OF  SAMPLE*** 
******0BSERVE0  raw  VARINAX  ROTATED  FACTOR  PATTERI*********************** 

DO  3001  H=l,24 
DO  1162  1=1,4 

PRL0AD(I,1.H)=0 
DO  1161  J=1,IVAR 

PRL0AD(I,1,H)=PRL0AD{I,1,H)+(TRL0AD(I,J)*RV(J,1,H)) 

1161  COITIIUE 

1162  COITIIUE 

DO  1154  1=1,4 

PRL0AD(I.2,H)=0 
DO  1163  J=1,IVAR 

PRL0AD(I,2,H)=PRL0AD(I,2,H)+(TRL0AD(I,J)*RV(J,2,I)) 

1163  COITIIUE 
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1164  COITIIUE 


DO  1166  1=1,4 

PRLOAD(I,3,H)=0 
DO  1166  J=1.IVAR 

PRLOAD(I,3,H)=PRLOAD(I.3.H)+(TRLOAO(1.J)*RV(J,3.H)) 
1166  COITIIUE 

1166  COITIIUE 

DO  1168  1=1,4 
PRL0AD(I.4,H)=0 
DO  1167  J=1,IVAR 

PIIL0AD(I.4,H)=PRL0AD(I.4,B)+(TRU1A0(1.J)*RV(J.4.H)) 

1167  COPTIBUE 

1168  COITIIUE 


IUMHITS(B,S)=0 
DO  1166  1=1,4 

IUNBITS(B,S)=IUMBITS(H,S)4PRLOAD(I ,I ,B) 

1169  COITIIUE 

3001  COITIIUE 

**«*«*DETERKIIE  BEST  PERMUTATIOI  BY  DETERNIIIIC  BIGBEST  SCORIIG*****o 
*♦♦>»** (lUMHITS)  OF  ALL  PERmTiATIOIS********'- 

BRV=IUMBITS(1,S) 

ID=0 

DO  3600  B=2,24 

IF  (IUNBITS(B,S)  .GT.  BRV)  TBEI 
BRV=IUNBITS(B,S) 

ID>B 
EID  IF 

3600  COITIIUE 

VS  ARE  lOV  V0RKII6  WITB  TBE  LAST  OF  OUR  SAMPLE********* 
««*****UIROTATED  FACTOR  PATTERIS,  CALCULATE  THE  AVERAGE********** 
*******IUI!BER  OF  HATCHES  FOR  THE  SAMPLE************************** 

SUMPR>SUMPR*BRV 

IF  (S  .EO.  SAMPLE)  TBEI 

ABRBITS=FLOAT(SUMPR)/FLOAT(SAMPLE} 

EID  IF 

******CALCUUTE  THE  EIGEIVALUES  FOR  THE  BEST  PERMUTED  OBSERVED****** 
******  SAMPLE  RAV  VARINAX  ROTATED  FACTOR  PATTBRI***********-::********* 


DO  287  J=l,4 

PIIUM(1.J.S}=0.0 
DO  266  1=1,16 

PIIUNCl . J . S)  =PIVUM(1 . J , S) *PERM(I . J , 10)**2 
266  COITIIUE 
287  COITIIUE 


******CALCULATE  THE  EIGEIVALUE  RMSR  FOR  EACH  BEST  PERMUTED  SAMPLE** 
******RAV  VARIMAX  ROTATED  SAMPLE  FACTOR  PATTERI******************** 

DO  492  J=1.4 

PRERCl . J ,S}=(PIIUM( 1 . J ,S)-IIUM( J) )**2 

492  COITIIUE 

PESR=0.0 
DO  493  J=l,4 

PESR=PESR*PRER( 1 , J . S) 

493  COITIIUE 

PRMESB(S)=SqRT(PESR/4) 


******CALCUUTE  TBE  LOADIIG  RMSR  FOR  BACH  BEST  PERMUTED  SAMPLE***** 
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******M.V  VARIHAX  ROTATED  SAMPLE  FACTOR  PATTERS******************** 


DO  924  1=1,16 
DO  923  J=1 ,4 

R(1.J)=(L0AD(I,J)-PERM(I,J,ID))**2 

923  COmiUE 

924  COITIIUE 

SR=0.0 

DO  926  1=1,16 
DO  925  J=1.4 
SR=SR*R(I,J} 

925  COITIIUE 

926  COITIIUE 

PRMSR(S)=SqRT(SR/(16*4)) 


HE  ARE  lOH  WORKIIG  WITH  THE  LAST  OF  OUR  SAMPLE********** 
*******RAH  VARINAX  ROTATED  FACTOR  PATTERIS,  CALCULATE  THE  AVERAGE* 
*******EIGEIVALUE  RMSR  FOR  THE  SAMPLE***************************** 

IF  (S  .EQ.  SAMPLE)  THEI 
PRAMESR=0.0 
DO  888  J=l, SAMPLE 

PRAMESR=PRANESR*PRMESR( J ) 

880  COITIIUE 

PRAMESR=PRANESR/SAMPLE 

*****CALC0LATE  THE  STAIDARD  DEVIATIOI  OF  THE  LOADIIGS************* 
*****RMSR  FOR  TEE  SAMPLE  OF  OBSERVED  RAH  VARIMAX  ROTATED  PATTERIS* 

RSSE=0.0 

DO  1084  J=l, SAMPLE 

RSSE=RSSE*(PRNESR(J)-PRAMESR)**2 
1084  COITIIUE 

SDRE=SqRT(RSSE/ (SAMPLB-1 ) ) 

EID  IF 

«*«**«SET  K  TO  1  TO  PERFORM  RAH  VARIMAX  ROTATIOI  OH  EACH  OF  THE**** 
««««««OBSERVEO  SAMPLE  UIROTATED  FACTOR  PATTERIS******************** 


X=1 

CALL  FROTA  (IVAR,  IF,  A,  LOA,  lORM,  NAXIT,  U.  EPS,  C,  LOB,  T. 
*LDT) 

««****CALCULATE  EIGEIVALUES  lORMAL  VARIMAX  ROTATED  FACTOR  PATTERI*** 
******THE  MUST  BE  DOIE  TO  CALCULATE  MEASURES  OF  MERIT  AID  TO  EISURE* 
««****THE  ROTATED  FACTOR  PATTERI  IS  IM  THE  CORRECT  COLUNI  ORDER***** 

DO  283  J=1.4 

XIUM(1,J,S)=0.0 
DO  268  1=1,16 

XIUM(1,J,S)  =XIUM(l.J,S)-*-C(I,J}**2 
268  COITIIUE 
283  COITIIUE 

*4i****S0RT  each  COLUMI  of  the  EIGEIVALUES  OF  THE  ROTATED  PATTERI**** 
**#***ptrr  FACTOR  PATTERI  COLUMI  II  CORRESPOIDIIG  ORDER************** 

BIG=0.0 

DO  1221  J=1,IF 

IF  (X1UM(1,J,S)  .GT.  BIG)  THEI 
BIG=XIUM(1,J,S) 

AA=J 

EID  IF 

1221  COITIIUE 
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KIUM(1.AA.S}=0.0 

BIG=0.0 

DO  1223  J=1,MF 

IF  (KIUMd.J.S)  .GT.  BIG)  THE! 

BIG=KMUN(1,J.S} 

BB=J 
BID  IF 

1223  COITIIUE 

KIUN(1.BB.S}=0.0 

BIG=0.0 

DO  1225  J=1,1IF 

IF  (XRUNd.J.S)  .GT.  BIG)  THEI 
BIGsKIUHd.J.S) 

CC=J 
EID  IF 

1225  COITIIUE 

KIDMd,CC,S)=0.0 

BIG=0.0 

DO  1227  J=1,IF 

IF  (KlUMd.J.S)  .GT.  BIG)  THEI 
BIGsKIUMd.J.S) 

DD=J 
EID  IF 

1227  COITIIUE 

KIUM(l.DD.S)  -0.0 

DO  1228  lel.lVAR 

CKa,l)«C(I,AA) 

aC(I,2)sC<I,BB) 

CK(I,3)»C(I,CC) 

CK(I,4)=C(I,DD) 

1228  COITIIUE 

♦♦♦♦♦♦write  CORRECTED  lORHAL  VARIMAX  FACTOR  PATTERI****************** 

*  PRIIT*. 'CORRECTED  ROTATED  lORNAL  VARIMAX* 

*  PRUT* 

*  «RITE(*,10)((CK(I,J).J«=1,IF),I=1,LDB  ) 

*  PRIIT* 

♦♦♦♦♦♦WRITE  UlCORRECTED  lORMAL  VARIMAX  FACTOR  PATTERI****************** 


>  PRUT*, 'UlCORRECTED  ROTATED  lORMAL  VARIMAX* 

■  PRIIT* 

>  WRITE(*.10)((C(I,J),J=1,IF),I=1,LDB  ) 

>  PRUT* 

'*****CALCUUTE  EACH  PERMUTATIOI  OF  lORMAL  VARIMAX  ROTATED************ 
r^^^^^FRCTOR  PATTERI************************************************** 


2110 

2111 


2112 


DO  2111  Isl.lVAR 
DO  2110  J-1,IF 
PERM(I,J,1)=CK(I,J) 
COITIIUE 
COITIIUE 


DO  2112  1=1 
PERM(I.1,2; 

1.16 

l=CK( 

I.l) 

PERM( 

1.2.2 

l=CK( 

1.2) 

PERM 

1.3.2 

l=CK( 

1.4) 

PERNi 

;i,4,2: 

»=CK( 

1.3) 

COITIIUE 

DO  2113  1=1,16 
PERM(I,1,3)=CK(I,1) 
PERM(I,2,3)=CK(I,3) 
PERH(I,3,3)=CK(I,2) 
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PERM(I.4.3)=CK(I,4) 
2113  C08TIHUE 


DO  2114  1=] 
PERM(I,1,4, 

1.16 

)=CK 

I.l) 

PERM(I,2,4 

i=CK 

1.3 

PERM<I,3,4, 

i=CK 

PEIUI(I,4,4; 

>=CK( 

1.2) 

2114  COITIIUE 


DO  2115  1=1,16 

PERN 

:i,l,6)=CK 

I.l 

PERN 

I.2,5)=CK 

1.4 

PERMi 

I.3,6)=CK 

1.2 

PERH( 

I,4,S)=CK( 

1.3) 

2116  COITIIUE 


DO  2116  1=1,16 

PEllM(I.1.6j=CK(I.l) 

PERMCI.2.6)=CK(1,4) 

PE1U!(I.3,6)=CKCI,3) 

PE!UC(I,4,6)=CK(I,2) 

2116  COITIIUE 

DO  2117  1=1,16 

PERM<I,l,7j=CK(I,2) 

PEIW(I,2.7)=CK{I,1) 

PEW(CI,3,7)=CK(1,3) 

PERM(I,4,7)=CK(1,4) 

2117  COITIIUE 


DO  2118  1=1 
PERN(I,1.8 

L,16 

)=CK 

1.2) 

PERN( 

1,2,8 

)=CK 

I.lj 

PERK 

1.3.8 

l=CK( 

1.4) 

PERN( 

1.4.8 

=CK( 

1.3) 

COITIIUE 


DO  2119  1=1,16 

PEWI(I,1,9)=CK(I,2) 

PEKN(I,2,9)=CKa,3) 

PEIW(I,3,9)=CK(I,1) 

PESM(I,4,9)=CK(I.4) 

COITIIUE 


DO  2120  1=1, 

16 

PERNi 

1.1.10, 

=CK 

1,2 

PERMI 

1.2.10 

=CK 

1,3 

PERNI 

1,3,10, 

=CK 

1.4 

PERN( 

1.4.10) 

=CK( 

I.l) 

2120  COITIIUE 


DO  2121  1=1 

16 

PERN 

1.1.11 

=CK 

1.2 

PERNI 

1.2,11 

=CK 

1,4) 

PERNI 

1.3.11, 

It 

o 

I.l 

PERN( 

1.4.11) 

=CK( 

1.3) 

COITIIUE 


DO  2122  1=1,16 
PERM(I,1,12)=C 
PEHMCI,2,12)=C 
PEM{I,3,12)=C: 
PERM(I,4.12)=C 

2122  COITIIUE 

DO  2123  1=1,16 
PEWC(I,1,13)=C; 
PE11I!(I,2,13)=C1 
PSRM(I,3,13)=C1 
PEim(I,4,13)=CI 

2123  COITIIUE 


)-CK< 

1.2) 

O 

It 

1.4) 

o 

II 

1.3) 

)=CK( 

1,1) 

)=CK( 

1.3) 

)=CK( 

1,1) 

)=CK( 

1.2) 

)=CK( 

1.4) 

DO  2124 

PEWI(I,l,14)=CKfl,3> 
PEIUia.2,14)=CKa.l) 
PERM(I,3,14)=CKa,4) 
PERII(I,4,14)=CK(I,2) 
2124  COITIlUB 

DO  2126  I«l,16 

peiui(i.i.is5=ck(i,3) 

PERMa,2.l6)=CK(I.2) 
PEIUI(I,3.16)=CK(1,1) 
PERlI(I,4,16)=CKa,4) 
2126  COITIlUB 

DO  2126  1-1,16 
PERII(I,1.16)=CKCI,3) 
PEWI(I.2,16)=CK(I,2) 
PERI(I,3,16)=CX(I,4) 
PER1I(I,4,16)=CK(I,1) 
2126  COITIlUB 


DO  2127  1=1. 

46 

PEMI( 

1.1.17 

l=CK( 

1.35 

PERN 

1.2.17 

l=CK( 

PERN 

1.3.17 

l=CK( 

I.l) 

PERN( 

!l.4.17j 

l=CK( 

1.2) 

2127  COITIlUB 

DO  2128  1^1,16 

PEIUI?I.1.18]«CK(I.3) 

PEIUI(I,2.18)-CK(I,4) 

PERM(I.3,18)=CK(I.25 

PEIU(<I.4.18)eCK(I,l) 

2128  COITIlUB 

DO  2120  I>1,16 

P8{UI(I.1.18)-CK(I.4) 

PEIU((I.2.19)>=CK(I,1} 

PERN(I.3.10)bCK(I.2) 

PERN(I.4.19)*CK(I,3) 

2129  COITIlUB 

DO  2130  I<il,16 

PEM(I,1,20]bCK(I,4) 

PEM(I,2,20)<:CXa,l) 

PERII(1.3.20)bCK(I,3) 

PEiUI(I.4,20}>CK(I.2) 

2130  COITIlUB 


DO  2131  I«l, 

16 

PERN( 

1.1.21 

l*CK( 

1.4) 

PERN 

1.2.21 

l=CKI 

12) 

PERN 

1.3,21 

l=CK< 

1.1) 

PERN( 

1.4.21 

l*CK( 

1.3) 

2131  COITIlUB 


DO  2132  I>1 
PBM(I,1,22 
PE1UI(I,2,22 
PB1UI(I,3.22, 
PERM(I.4.22 
2132  COITIlUB 


16 

»CK{I,4 

«=CK(I,2 

=ClCfI,3 

»CK(I.l 


DO  2133  I«l,16 
PEIUI(I,l,23}eCK(I,4 
PE!UI(I.2.23)°CK(I,3, 
PEIUI(I.3.23)<=CKa.l 
PEiU((I,4.23)sCX(I,2; 
2133  COITIlUB 
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PEflll(I.3,24)=CK(I,2) 

PERMa,4,24)=CK(I.l) 

2134  CORTIRUE 

•*****PUT  ALL  PEPMUTTED  MATRICES  IITO  BIIART  FORM  II  PREPARATIOI  TO**** 
******P05T  MULTIPLY  THE  TRAISPOSE  OF  THE  EXPERIMEITAL  FACTOR  PATTER!*** 

******TO  DETERMIIE  BEST  FACTOR  PATTERI  SCORE*************************** 

DO  1853  1=1,24 
DO  1941  I=1,IVAR 
DO  1940  J=1,IF 
KV(I,J.H)=0 

1940  CORTIRUE 

1941  CORTIRUE 

DO  1952  I=1,IVAR 

BIG=ABS(PERN(I,1,B)) 

L0CBIG=1 
KV(I,1,H)=1 
DO  1961  J=2,RF 

IF  (ABS(PEaM(I.J,H))  .GT.  BIG)  TBEI 
KVri,J,H)=l 
KV{I,L0CBIG.K)*0 
BIG=ABS(PERM(I,J.B)) 

LOCBIG=J 
ERD  IF 

1961  CORTIRUE 

1962  CORTIRUE 

1963  CORTIRUE 

«*««**CALCULATE  PATTER!  MATCBIRG  SCORE  FOR  EACH  PERMUTATIOR  OF  SAMPLE*** 
♦OBSERVED  RORMAL  VARIMAX  ROTATED  FACTOR  PATTERI******************** 

DO  3002  B=l,24 
DO  1162  1=1,4 

PRL0AD(I,1,H)«0 
DO  1161  J=1.IVAR 

PRLOAO(I,1,H)=PRLOAO(I,1,H)*(TRLOAO(I,J)*KV(J,1,B)) 

1161  CORTIRUE 

1162  CORTIRUE 

DO  1164  1=1,4 

PRL0AD(I.2,H)=0 
DO  1163  J=1,IVAR 

PRL0AD(:,2,H}=PRL0A0(I,2,H}*(TRL0AD(I,J)*ICV(J,2.H)) 

1163  CORTIRUE 

1164  CORTIRUE 

DO  1166  1=1,4 

PRL0AD(I,3,H}=0 
DO  1166  J=1,IVAR 

PRL0AD(I,3,H)=PBL0AD(I,3,I)+(TRL0AD(I,J)*KV(J,3,H)) 

1166  CORTIRUE 

1166  CORTIRUE 

DO  1168  1=1,4 

PRL0AD(I,4,H)=0 
DO  1167  J=1,IVAR 

PRLOAD(I,4,H)=PRLOAO(I,4,E)+(TRLOAD(I,J)*KV(J.4,H)) 

1167  CORTIRUE 

1168  CORTIRUE 

IUNIITS(a,S)=0 
DO  1169  1=1,4 

RUMBITS  (  H .  S  }  =RUNHITS  (H ,  S  ) -fPRLOAD  ( 1 , 1 ,  H) 

1169  CORTIRUE 
3002  CORTIRUE 

♦*****DETERMIRE  BEST  PERMUTATIOR  BY  DETERMIRIIG  HIGHEST  SCORIRG***** 
•*•♦*♦ (RUMHITS)  OF  ALL  PERMUTATIORS***************  ****************** 

BKI=RUMRITS(1,S) 

ID=0 
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DO  3700  H=2,24 

IF  (lUHHITSCH.S)  .CT.  HKI)  THE« 

HKI=IUNHITS(H.S) 

ID=H 
EID  IF 
3700  COVTIKUE 

•******IP  VE  ARE  lOV  VORXIIG  UITB  THE  LAST  OF  OUR  SAMPLE********* 
*«*****|OR)|AL  VARIMAX  ROTATED  FACTOR  PATTERIS,  CALCUUTE  ******** 
•******THE  average  HUMBER  OF  MATCHES  FOR  THE  SAMPLE************** 

SUMPR*SUMPK*BKI 

IF  (S  .EQ.  SAMPLE)  THEM 

ABKHITS=FLOAT( SUMPK ) /FLOAT(SAMPLE) 

EID  IF 

•******CALCULATE  EIGEIVALUES  BEST  PERMUTTED  KAISER  VARIMAX********* 

DO  083  J«1.4 

PKIUMCl  J,S)cO.O 
DO  088  I>i;i8 

PKHUM(1,J,S)  =PKfUM(l,J,S)+PERM(I,J,ID)**2 
088  COITIHUE 
083  COITIHUE 

******CALCULATE  THE  EIGEIVALUE  RMSR  FOR  EACH  BEST  PERMUTED  SAMPLE** 
«*««**fOIlMAL  VARIMAX  ROTATED  SAMPLE  FACTOR  PATTERI********»******** 

DO  442  >1.4 

PRER(l,J,S)*(PKHt'!;(l,J,S)-IHUM(J))**2 

442  COITIlUB 

FESR*0.0 

DO  443  >1,4 
PESRePESR*PP£R( 1 , J , S) 

443  COITIHUE 

PKMESR(S}>SqRT(PESR/4} 

•«*««*CALCULATB  THE  LOADIIG  RMSR  FOR  EACH  BEST  PERMUTED  SAMPLE***** 
******|ORMAL  VARIMAX  ROTATED  SAMPLE  FACTOR  PATTERI***************** 

DO  014  1>1.18 
DO  013  >1.4 

R(I,J)«(L0AD(I,J)-PERM(I,J,ID))**2 
013  COITIHUE 
014  COITIIUE 

-  --  SR»o;o 

DO  016  >1,16 
DO  OIB  >1.4 
SR*SR*R(I,J) 

OIS  COITIlUB 
010  COITIIUE 

PKMSR(S)»SqRT(SR/(18*4)) 


**v****IF  VE  ARE  lOV  VORKIIG  VITB  THE  LAST  OF  OUR  SAMPLE********* 
VARIMAX  ROTATED  FACTOR  PATTERIS.  CALCUUTE  THE***** 
*«*****AVERAGE  EIGEIVALUE  RMSR  FOR  THE  SAMPLE******************** 


IF  (S  .Eq.  SAMPLE)  TBEI 

PKAMESR«0.0 
DO  445  >1.  SAMPLE 

PKAMESR=PKAMESR+PKMESR(J} 

445  COITIIUE 

PKAMESR*PKAHESR/SAMPLE 

*««*«*CALCUUTE  THE  STAIDARD  DEVIATIOI  OF  THE  BIGEIVALOE********* 
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RMSR  FOR  THE  SAMPU  OF  OBSERVED  UIROTATED  PATTERRS********* 


KSSE=0.0 

DO  664  J=l, SAMPLE 

KSSE=KSSE+ { PKMESRC J ) -PKAMESR) **2 
564  COrriHUE 

SDKE=SqRT(KSSE/(SANPLE-l)) 

*«*****IF  WE  ARE  lOH  WORKIIG  WITH  THE  UST  OF  OUR  SAMPLE********* 
*******|IORMAL  VARIMAX  FACTOR  PATTERIS.  CALCULATE  THE  AVERAGE***** 

*******LOADIHGS  RMSR  FOR  THE  SAMPLE****************************** 

PKAHSR^O.O 
DO  066  J=i. SAMPLE 

PKAMSR=PKAMSRfPKNSR(J) 

966  COITIEUE 

PKANSR=PKANSR/SAMPLE 

•****CALCULATE  THE  STAIDARD  DEVIATIOI  OF  THE  LOADIMGS*********** 
•****RMSR  FOR  THE  SAMPLE  OF  OBSERVED  UIROTATED  PATTERIS********* 

PKSSM=0.0 
DO  B73  J=l, SAMPLE 

PKSSM=PKSSM* (PKMSR( J) -PXAMSR) **2 
073  cn-  SUE  1 

PS  ;»SQRT(PKSSM/(SAMPLE-1)) 

EsD  IF 

»«****EID  loop  for  READIIO  100  SAMPLES******************** 

300  COITIIUE  ! 

CL0SE(2)  I 

I 

******WRITE  DATA  TO  'ont.dat*  FILE************************ 

I 

****«,.COUHTsSTRUCTOR  HUMBER 
««****HIIDEX>>UII0U^IESS  IIDEZ 
^•aaaaCIIDEX^COMPLEXITr  IlDEX 
******AIBHITS«AVERAGB  UIROTATED  MATCIIIG  SCORE 
*«****PAMSR=AVCRAGE  UIROTATED  LOADIIGS  RMSR 
******PSDUM«STD  DE\^  UIROTATED  LOADIIGS  RMSR 
*«**4,*PiMESR=AVERAGE  UIROTATED  EIGEIVALUE  RMSR 
**a««,«SDUE=STD  DEV  UIROTATED  EIGEIVALUE  RMSR 
******ABRHITS-AVERAGE  ROTATED  RAW  NATCHIIG  SCORE 
******PRAMSR>AVERAGE  ROTATED  RAH  LOADIIGS  RMSR 
******PSDRMsSTD  DEV  ROTATED  RAW  LOADIIGS  RMSR 
******PRAMESR  ^AVERAGE  ROTATED  RAH  EIGEIVALUE  RMSR 
**«***SDRE*STD  DEV  ROTATED  RAW  BIGEITALUG  RMSR 
«*****ABKHITS=AVERAGE  ROTATED  lORNAL  MATCHIIG  SCORE 
******PKAMSR*AVERAGE  ROTATED  lORMAL  LOADIIGS  RMSR 
*aa««*PSDKM=STD  DEV  ROTATED  lORMAL  LOADIIGS  RMSR 
**«v**PKAMESR»AVERAGE  rotated  lORMAL  EIGEIVALUE  RMSR 
******SDKEsSTD  DEV  ROTATED  lORMAL  EIGEIVALUE  RMSR 
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WRITE( 26 , 7006 ) COURT . STRAT , HIMDEX , CIIDEX 
RP ANSR , PSDUN , PAHESR , SDUE , 

RABRHITS . PRAMSR . PSDRM , PRAHESR , 

RSDRE , ABKBITS , PKANSR , PSDKK . PKAHESR , ^KE 

7006  F0RMAT(lXI3.1XF6.3.1XF6.3,iXF6.3.1XFS.l 
RlXF9.e.lXF9.6.1XF9.6.iXF9.5.iXFS.l.lXF9 
R1XF9.6.1XF9.S.1XF6.1.1XF9.B.1XF9.S.1XF9 

CL0SE(26) 

EID 


AIBHITS, 


B,1XF9.5. 

B.1XF9.B) 
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Appendix  E.  Residual  Plots 

This  Appendix  illustrates  the  residual  plots  for  the  pattern  matching  regression 
model. 


Raw  Fa§or*^alem°^atche8 


Appendix  J.  Factor  Plots 

This  Appendix  illustrates  the  Factor  plot  for  the  RMSER  factor  Anad 
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Appendix  K.  Kaiser  Data 


K.l  Correlation  Matrix 

This  Appendix  lists  the  correlation  matrix  for  the  Holzinger  and  Harman  psy¬ 
chological  tests  (Holzinger  and  Harmam,  1941).  Note  the  matrix  has  been  split  into 
two  (24*8)  matrices  to  fit  on  the  page. 


1  .318  .403  .468 

.318  1  .317  .230 

.403  .317  1  .306 

.468  .230  .30E  1 

.321  .286  .247  .227 
.335  .234  .268  .327 
.304  .157  .223  .336 
.332  .167  .382  .391 
.326  .196  .184  .326 
.116  .067  -.076  .099 
.308  .160  .091  .110 
.314  .146  .140  .160 
.489  .239  .321  .327 
.126  .103  .177  .066 
.238  .131  .066  .127 
.414  .272  .263  .322 
.176  .006  .177  .187 
.368  .255  .211  .261 
.270  .112  .312  .137 
.366  .292  .297  .339 
.369  .306  .165  .349 
.413  .232  .260  .380 
.474  .348  .383  .336 
.282  .211  .203  .248 

439  .126  .238  .414 
.239  .103  .131  .272 
.321  .177  .065  .263 
.327  .066  .127  .322 
.344  .280  229  .187 

.309  .292  .261  .291 
.346  .236  .172  .180 
.395  .262  .176  .296 
.280  .260  .248  .242 
.408  .172  .164  .124 
.635  .360  .240  .314 
.612  .131  .173  .119 
1  .195  .139  .281 

.196  1  .370  .412 

.139  .370  1  .325 

.281  .412  .325  1 
.194  .341  .346  .324 
.323  .201  .334  .344 
.263  .200  .192  .268 
.241  .302  .272  .388 
.426  .183  .232  .348 
.279  .243  .246  .283 
.382  .242  .266  .360 
.368  .304  .165  .262 


321  .335  .304  .332 
286  .234  .167  .167 
247  .263  .223  .382 
227  327  .336  .391 
1  .622  .666  .678 

622  1  .722  .627 

666  .722  1  .619 

678  .627  .619  1 
723  .714  .686  .632 
.311  .203  .246  .286 
344  .353  .232  .300 
216  .096  .181  .271 
344  .309  .346  .396 
280  .292  .236  .252 
229  .261  .172  .176 
187  .291  .180  .296 
208  .273  .228  .265 
263  .167  .169  .260 
190  .261  .226  .274 
398  .436  .461  .427 
318  .263  .314  .362 
441  .386  .396  .367 
.436  .431  .406  .601 
.420  .433  .437  .388 

.176  .368  .270  .366 
.005  .266  .112  .292 
.177  .211  .312  .297 
.187  .261  .137  .339 
.208  .263  .190  .398 
.273  .167  .261  .435 
.228  .169  .226  .451 
.236  .260  .274  .427 
.274  .208  .274  .446 
.289  .317  .190  .173 
.362  .350  .290  .202 
.278  .349  .110  .246 
.194  .323  .263  .241 
.341  .201  .206  .302 
.345  .334  .192  .272 
.324  .344  .268  .388 
1  .448  .324  .262 

.448  1  .368  .301 

.324  .368  1  .167 

.262  .301  .167  1 

.173  .367  .331  .413 
.273  .317  .342  .463 
.287  .272  .303  .609 
.326  .405  .374  .366 


.326  .116  .308  .314 
195  .067  .160  .145 
184  -.076  .091  .140 
.326  .099  .110  .160 
723  .311  .344  .216 
714  .203  .363  .096 
686  .246  .232  .181 
632  .285  .300  .271 
1  .170  .280  .113 

.170  1  .484  .685 

280  .484  1  .428 

113  .685  .428  1 

280  .403  .635  .612 
260  .172  .360  .131 
248  .164  .240  .173 
242  .124  .314  .119 
274  .289  362  .278 
208  .317  .360  .349 
274  .190  .290  .110 
446  .173  .202  .246 
266  .405  .399  .366 
483  .160  .304  .193 
504  .262  .261  .360 
.424  .531  .412  .414 

.369  .413  .474  .282 
.306  .232  .348  .211 
.166  .250  .383  .203 
.349  .380  .336  .248 
.318  .441  .436  .420 
.263  .386  .431  .433 
.314  .396  .406  .437 
.362  .367  .601  .388 
.266  .483  .604  .424 
.406  .160  .262  .531 
.399  .304  .261  .412 
.365  .193  .360  .414 
.426  .279  .382  .358 
.183  .243  .242  .304 
.232  .246  .266  .166 
.348  .283  .360  .262 
.173  .273  .287  .326 
.367  .317  .272  .406 
.331  .342  .303  .374 
.413  .463  .609  .366 
1  .374  .461  .448 

.374  1  .603  .376 

.451  .603  1  .434 
.448  .375  .434  1 
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